Senior Data Engineer
$95K-$173K (Glassdoor est.)
The mission of our data team at Red Ventures to make data easy-to-use for everyone. We are hiring Sr. Data Engineers who are excited to overcome challenges, work with the latest AWS technologies, and continue making our data better. Our Sr. Data Engineers are a key part of building our data infrastructure. Basically, we are using Spark as our universal program on how we are transferring data across multiple platforms.

What You'll Do:
Use Spark for streaming applications and/or as an ETL tool, Data Aggregation, User Defined Functions, as well as the Spark UI to analyze behavior and performance.
Design, develop and automate high-quality, scalable solutions across the entire data lifecycle, from raw data to powerful insights and analytics.
What We're Looking For:
Spark, working in RDDs and DataFrames/Datasets API (with emphasis on DataFrames) to query and perform data manipulation
Spark Structured Streaming (We process a ton of data in real time)
Experience building large scale Spark applications, ideally with either Batch processing and/or Streaming processing
Scala would be ideal but a solid knowledge of Java is also acceptable
Experience in SparkSQL (Broadcast Joins)
Experience with cloud computing platforms, we use AWS (Kinesis, S3, Lambda or DynamoDB would also work)
Has experience with ANSI SQL relational database (Oracle, SQL, Postgres, MySQL)
Even Better:
Linux common working knowledge, including navigating through the file system and simple bash scripting
General knowledge of distributed systems and distributed data processing frameworks
Experience with Storm, Kafka, or Cassandra is a plus
Knowledge about agile software processes
Who We Are:

Founded in 2000, Red Ventures is a portfolio of growing digital businesses that bring consumers and brands together through integrated e-commerce, strategic partnerships and many proprietary brands including Bankrate, AllConnect.com and Reviews.com. Headquartered south of Charlotte, NC, Red Ventures has over 3000 employees in offices across the US, as well as London and Sao Paulo. For more information, visit www.redventures.com.

At Red Ventures we believe that diversity makes us stronger - at work and in the world. Red Ventures is an equal opportunity employer that does not discriminate against any employee or applicant because of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or any other basis protected by law. Employment at Red Ventures is based solely on a person's merit and qualifications.
Red Ventures
3.2
Red Ventures
