Senior Data Engineer
PG&E Corporation
Oakland, California
senior
data
engineer
data
team
leadership
infrastructure
information technology
information systems
analytics
scientists
engineers
data driven
Apply with Tarta Assistant 🤖
Unleash the power of automation for your job search (Paid option) Apply Manually(Free)
I have time, I'll manually find and apply for jobs
Unleash the power of automation for your job search (Paid option) Apply Manually(Free)
I have time, I'll manually find and apply for jobs
90% of users say Tarta.ai Assistant helps them save time applying for jobs.
Not a member? Click
here to subscribe.
November 23, 2022
PG&E Corporation
Oakland, California
FULL_TIME
Requisition ID # 140682
Job Category: Information Technology
Job Level: Individual Contributor
Business Unit: Information Technology
Work Type: Hybrid
Job Location: Oakland
Department Overview
Information Systems Technology Services is a unified organization comprised of various departments which collaborate effectively in order to deliver high quality technology solutions.
Position Summary
We are looking for a savvy Data Engineer to join our growing team of analytics experts. In this role you will work as part of cross functional teams, including data scientists, other data engineers, technology experts, and subject matter experts to develop data driven solutions. Successful candidates will be responsible for building, expanding, and optimizing our data, data storage, and data pipeline. This individual will support team members and decision products to ensure that data delivery is reliable and optimized. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. facilitative leadership this role will help the team continue its history of success. Qualified candidates will have a unique opportunity to be at the forefront of the utility industry and gain a comprehensive view of the nation's most advance smart grid. It is the perfect role for someone who would like to continue to build upon their professional experience and help advance PG&E's sustainability goals.
Responsibilities:
Leads data engineering activities on moderate to complex data and analytics-centric problems which have broad impact and require in-depth analysis to obtain desired results.
Plans work to meet mutually agreed to objectives; reviews progress with team members regularly; documents work in a manner that is aligned with best practices
Identifies, designs, and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
Resolves application programming analysis problems of broad scope within procedural guidelines.
Actively participates in agile/scrum ceremonies (stand ups, planning, retrospectives, etc.)
Builds and conducts automated and user acceptances tests as part of an iterative development process
Promotes a continuous improvement mindset by engaging in after action reviews and sharing learnings
Broader Data System and Architecture Maturity
Assesses performance of individual data pipeline and broader data systems, suggests and may implement changes as required to meet individual project or enterprise maturity objectives
Provides assistance to other programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas. May require creative/non-standard approaches to solve problems that will have significant impact across the company
Conceptualizes and generates infrastructure that allows big data to be accessed and analyzed with verified data quality and metadata is appropriately captured and catalogued
Work with team leadership to continually improve data driven decision making at PG&E via demonstrations, mentoring, disseminating best practices, etc.
Minimum Qualifications:
Job Category: Information Technology
Job Level: Individual Contributor
Business Unit: Information Technology
Work Type: Hybrid
Job Location: Oakland
Department Overview
Information Systems Technology Services is a unified organization comprised of various departments which collaborate effectively in order to deliver high quality technology solutions.
Position Summary
We are looking for a savvy Data Engineer to join our growing team of analytics experts. In this role you will work as part of cross functional teams, including data scientists, other data engineers, technology experts, and subject matter experts to develop data driven solutions. Successful candidates will be responsible for building, expanding, and optimizing our data, data storage, and data pipeline. This individual will support team members and decision products to ensure that data delivery is reliable and optimized. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. facilitative leadership this role will help the team continue its history of success. Qualified candidates will have a unique opportunity to be at the forefront of the utility industry and gain a comprehensive view of the nation's most advance smart grid. It is the perfect role for someone who would like to continue to build upon their professional experience and help advance PG&E's sustainability goals.
Responsibilities:
Leads data engineering activities on moderate to complex data and analytics-centric problems which have broad impact and require in-depth analysis to obtain desired results.
Plans work to meet mutually agreed to objectives; reviews progress with team members regularly; documents work in a manner that is aligned with best practices
Identifies, designs, and implements internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
Resolves application programming analysis problems of broad scope within procedural guidelines.
Actively participates in agile/scrum ceremonies (stand ups, planning, retrospectives, etc.)
Builds and conducts automated and user acceptances tests as part of an iterative development process
Promotes a continuous improvement mindset by engaging in after action reviews and sharing learnings
Broader Data System and Architecture Maturity
Assesses performance of individual data pipeline and broader data systems, suggests and may implement changes as required to meet individual project or enterprise maturity objectives
Provides assistance to other programmers/analysts on unusual or especially complex problems that cross multiple functional/technology areas. May require creative/non-standard approaches to solve problems that will have significant impact across the company
Conceptualizes and generates infrastructure that allows big data to be accessed and analyzed with verified data quality and metadata is appropriately captured and catalogued
Work with team leadership to continually improve data driven decision making at PG&E via demonstrations, mentoring, disseminating best practices, etc.
Minimum Qualifications:
- BA/BS or equivalent experience in appropriate technical discipline (Computer Science, Management Information Systems or equivalent experience and/or related field of study)
- 5 years of experience with data engineering/ETL ecosystems such as Palantir Foundry, Spark, Informatica.
- Python
- Pandas
- APIs
- Scikit Learn
- PySpark or equivalent big data processing framework
- Database design fundamentals
- Typescript
- Web application development
- Familiarity with a CI/CD tool
- Familiarity with an infrastructure as code tool
- Experience writing production-level code
- Experience writing health checks, unit tests, integration tests, schema validations
- Knowledge of Time Series data set development.
- Demonstrated commitment to teamwork and enabling others
- Proven ability to translate business desires into technical requirements
- Ability to communicate with various stakeholders and leadership
- Ability to breakdown an ambiguous problems
- Familiarity with cloud computing security fundamentals
- Experience with the Palantir Foundry platform
- Experience working with data scientists and machine learning engineers
- Familiarity with model deployment
- Front end tools: PowerBi, Tableau
Report this job
Similar jobs near me
Related articles
- The Affordable Care Act: A Comprehensive Guide to Healthcare Reform in the United States
- A Day in the Life of a Warehouse Worker
- Navigating the Job Market: Tips for Finding Warehouse Worker Positions
- 10 Must-Have Tips for Creating a Standout Warehouse Worker Resume
- What is a White-Collar Worker? Understanding the Definition and Characteristics