Data Pipeline Engineer

Job description

DATA ENGINEER

Who We Are?

Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering.

The company deploys a leading team that spun out of the largest solar power producer in the world.

This team operates within a sophisticated suite of software to support projects from land origination, through to commercial operation.

Location

Chennai

What We Offer

• Opportunity to join a top-notch, collaborative team of professionals
• Fantastic team environment and collaborative culture
• Professional development opportunities to grow into an industry leader
• Medical Insurance for the employee and family
• Spot Recognition bonus for exceptional performance
• Long Term Incentive policy
• Regular team outings, events, and activities to foster a positive work environment

Our Commitment to Diversity

At CIR, we are dedicated to nurturing a diverse and equitable workforce that truly reflects our community.

We deeply value each person’s unique perspective, skills, and experiences.

CIR embraces all individuals, regardless of race, religion, sexual orientation, gender identity, age, or nationality.

We are steadfast in our commitment to fostering a just and inclusive world through intentional policies and actions.

Your individuality enriches our collective strength, and we strive to ensure everyone feels respected, valued, and empowered.

Position Summary

As a Data Engineer, you would be required to take ownership of data infrastructure, pipeline development, and data curation for regulatory, zoning, renewable energy, and geospatial data applications.

This role involves handling large-scale datasets related to zoning laws, permitting, environmental regulations, and spatial data, ensuring data quality, and enabling seamless integration with AI/ML models.

The ideal candidate will be responsible for designing end-to-end data pipelines, supporting data-driven decision-making, and building and leading a data engineering team as they scale their operations.

Core Responsibilities

Data Engineering & Pipeline Development:

• Design and develop ETL pipelines to collect, clean, and transform regulatory and geospatial datasets.
• Build data ingestion pipelines for integrating zoning laws, permitting data, renewable energy regulations, GIS data, and environmental impact assessments.
• Work with PostGIS, PostgreSQL, and cloud-based storage solutions to manage structured and unstructured data.
• Develop automated data workflows to support AI/ML applications and real-time analytics.
• Ensure scalability, security, and performance of data architecture to handle large and diverse datasets.

Data Curation & Quality Assurance:

• Collect and preprocess zoning regulations, permitting documents, renewable energy policies, environmental impact assessments, and spatial data for AI applications.
• Implement data validation techniques to ensure accuracy and consistency.
• Maintain metadata, lineage tracking, and documentation for all datasets.
• Optimize regulatory and geospatial data storage, indexing, and querying for real-time performance.

Collaboration & Leadership:

• Work closely with AI/ML Engineers to align data structures with machine learning models.
• Collaborate with stakeholders to define data needs, storage strategies, and reporting workflows.
• Take the lead in hiring, training, and managing a data engineering team to scale operations effectively.
• Stay updated with emerging data engineering best practices and implement innovative solutions.

Education Requirements

Master’s or Ph.D. in Computer Science, Data Engineering, GIS, or related fields.

Technical Skills and Experience

Software Proficiency:

• Programming: Python (Pandas, NumPy, SQLAlchemy), SQL.
• Database & Storage: PostgreSQL, PostGIS, NoSQL, Cloud Data Warehouses (BigQuery, Snowflake, Redshift).
• Data Processing: Apache Airflow, Apache Spark, ETL frameworks, data lakes.
• Regulatory & GIS Data Management: Experience with QGIS, GDAL, GeoPandas, Google Earth Engine, and handling zoning/permitting datasets.
• Cloud & Infrastructure: AWS/GCP/Azure (S3, RDS, Lambda, EC2), Docker, Kubernetes.
• Big Data Processing: Experience with distributed computing, real-time data streaming, and indexing techniques.
• Communication: Strong ability to translate complex data requirements into business value.

Project Management:

• Design experience in projects from conception to implementation.
• Ability to coordinate with other engineers and stakeholders.

Renewable Energy Systems:

• Understanding of solar energy systems and their integration into existing infrastructure

Experience

• 2-4 years of experience
• Experience with automating regulatory data processing and AI-driven decision support systems.
• Strong understanding of vector databases, spatial indexing, and knowledge graphs.
• Hands-on experience building data architectures supporting ML/AI applications.

Psychosocial Skills /Human Skills/Behavioural Skills

• Strong analytical, organizational, and problem-solving skills.
• Management experience a plus.
• Must be a go-getter with an enterprising attitude
• A self-starter, able to demonstrate high levels of initiative and motivation
• Entrepreneurial mindset with the ability to take ideas and run with them from concept to conclusion.
• Technical understanding of clean energy business processes
• Exceptional verbal and writing communication skills with superiors, peers, partners, and other stakeholders.
• Excellent interpersonal skills while managing multiple priorities in a fast-paced and ever-changing environment.

Physical Demands

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job.

The physical demands of this job require an individual to be able to work at a computer for most of the day, be able to participate in conference calls and travel to team retreats on a time-to-time basis.

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Work Conditions

The work environment is usually quiet (normal city traffic noises are common), a blend of artificial and natural light, temperate and generally supports a collaborative work environment.

Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Equal Opportunity Employer

At Cleantech Industry Resources, we embrace diversity and uphold a strong dedication to establishing an all-encompassing atmosphere for both our staff and associates.

Our choices in employment are free from any bias related to race, creed, nationality, ethnicity, gender, sexual orientation, gender identity, gender expression, age, physical limitations, veteran status, or any other legally safeguarded attributes.

Being an integral part of Cleantech Industry Resources means you can expect to be immersed in a realm of professional possibilities within a culture that nurtures teamwork, adaptability, and the embracing of all.

Required Skill Profession

Computer Occupations