Data Engineeer
Appsierra
Skills
Job Description
As a Data Engineer, you will work with the development team to construct a data streaming platform and data warehouse that serves as the data foundations for our product. Help us scale our business to meet the needs of our growing customer base and develop new products on our platform. You'll be a critical part of our growing company, working on a cross-functional team to implement best practices in technology, architecture, and process. You’ll have the chance to work in an open and collaborative environment, receive hands-on mentorship and have ample opportunities to grow and accelerate your career!
Responsibilities
• Build our next generation data warehouse
• Build our event stream platform
• Translate user requirements for reporting and analysis into actionable deliverables
• Enhance automation, operation, and expansion of real-time and batch data environment
• Manage numerous projects in an ever-changing work environment
• Extract, transform, and load complex data into the data warehouse using cuttingedge technologies • Build processes for topnotch security, performance, reliability, and accuracy
• Provide mentorship and collaborate with fellow team members
Qualifications
• Bachelor’s or Master’s degree in Computer Science, Information Systems, Operations Research, or related field required
• 3+ years of experience building data pipelines
• 3+ years of experience building data frameworks for unit testing, data lineage tracking, and automation
• Fluency in Scala is required
• Working knowledge of Apache Spark
• Familiarity with streaming technologies (e.g., Kafka, Kinesis, Flink) Nice-to-Haves
• Experience with Machine Learning
• Familiarity with Looker a plus
• Knowledge of additional server-side programming languages (e.g. Golang, C#, Ruby)