Data Engineering Advisor

Vets Hired

Pomona, CA, USA

Published: 6/14/2022

Technology

Full Time

Job Description

Position: Data Engineering Advisor

Become a Data Engineering Advisor and build a better tomorrow. In this role, youll be responsible for creating and supporting analytical data marts by developing data integration pipelines (ETL) sourcing from various databases and systems. You will develop programs using coding languages (i.e., Python, SQL, PROC SQL, R) and/or low-code environments (i.e., Palantir Foundry) to create analyses and applications for stakeholders throughout the company. This role requires expertise in data architecture, engineering solutions, and best practices for analyzing large datasets. Additionally, you will perform data mining activities to derive insights, work with cloud OLAP systems (e.g., Snowflake), and stay updated on new data science, data engineering, and big data techniques.

Responsibilities:

Manage and scale data pipelines from internal and external data sources to support new product launches and ensure data quality.
Facilitate data engineering activities covering data acquisition, extraction, normalization, transformation, and manipulation of large and complex datasets.
Research, promote, and implement data engineering best practices, standards, and guidelines.
Collaborate with subject matter experts to design and develop front-end applications supported by data models and pipelines.
Provide governance and oversight of data assets and procedures, ensuring naming conventions and data consistency.
Build and maintain data pipelines using big data processing technologies.
Develop and maintain data warehouse schemas and data models.
Align technical strategies with evolving business needs and technology trends.
Create advanced data visualizations and tools to drive insights and support operations.
Identify and design Data-as-a-Service (DaaS) opportunities to improve data accessibility and usability.

Minimum Qualifications:

Bachelors Degree in Computer Science, Information Systems, Engineering, Statistics/Mathematics, or a related STEM field.
Seven or more years of experience in data processing, including transformation, aggregation, and filtering of large datasets.

Preferred Qualifications:

Certifications such as Palantir Foundry Data Engineer, Azure Data Engineer, Certified Data Management Professional, or SnowPro Advanced.
Experience building and maintaining APIs and ETL pipelines using tools like Python, SQL, Apache Airflow, or Azure Data Factory.
Familiarity with systems such as Palantir Foundry, Snowflake, SAP, or Oracle.
Understanding of cloud-based data storage and architecture.
Experience with data validation, metadata management, and maintaining data integrity.
Background in the electric utility industry or infrastructure investment planning.
Strong collaboration skills for working with cross-functional teams in IT, Engineering, Planning, and Business Units.