Principal Data Engineer, Data Platform & Insights
$116K-$209K (Glassdoor est.)
Location: San Francisco, CA- United States
Job ID: 20WD39526

Position Overview
Autodesk is seeking an experienced data engineer to join our growing engineering team within Data Platform & Insights (DPI). This team is at the heart of Autodesk’s efforts to radically improve how we create value for customers and make decisions through data.

As a data engineer on this team, you will help create a robust and scalable data platform for other teams across the company to leverage. This work will include tasks such as creating abstractions to speed the platform’s adoption and building reliable pipelines to support growing data processing and analytics needs. Ideally you will be a self-starter, detail and quality oriented, and excited about the prospects of having a big impact with data at Autodesk.

Responsibilities
Build and scale data infrastructure that powers batch and real-time data processing of billions of records daily
Improve the data quality and reliability of data pipelines through monitoring, validation and failure detection
Build foundational data sets that are trusted, well understood, aligned with business strategy and enable self-service
Interface with data scientists, analysts, product managers and all data stakeholders to understand their needs and promote best practices
Architect data pipelines that provide fast, optimized, and robust end-to-end solutions
Automate manual processes and create a platform in favor of self-service data consumption

Minimum Qualifications
5 years of relevant industry experience in Data Engineering working with large scale data driven systems
Problem solver with excellent written and interpersonal skills; ability to make sound, complex decisions in a fast-paced, technical environment
Familiar with workflow management tools, like Airflow and Oozie
Experience designing data schemas and fine-tuning queries around large, complex data sets
Experience working with big data frameworks, like Hive, Spark and Presto
Deep understanding of SQL, dimensional modeling, and analytical data warehouses, like Snowflake
Strong overall programming skills, able to write modular, maintainable code
Expertise in object-oriented and/or functional programming languages (Python preferred)
Understanding of polyglot data persistence (relational, key/value, document, column)
Bachelor’s degree in Computer Science, Engineering or related field, or equivalent training, fellowship or work experience
Autodesk
4.0
Autodesk
