Job Description
Remote Lead Data Engineer needs 7+ years' experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Remote Lead Data Engineer requires:
Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with:
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
- Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Mandatory Skills Advanced knowledge one of language: Java, Scala, Python, C#? Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with Data mining/programming tools (e.g.?SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Remote Lead Data Engineer duties:
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services.
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Employment Type: Full-Time
Salary: $ 110.00 Per Hour
Job Tags
Hourly pay, Full time,
Similar Jobs
CID Design Group
...As an Assistant Interior Designer, you will work on a fabulous and fun team of other talented designers, receive support from a mentor, and participate in all project phases through project coordination, organization, and documentation. WHAT YOU'LL DO Prepare Revit...
Southwest Coalition, Inc.
...division of Southwest Coalition, Inc., is searching for Certified Nurse Midwives to join its non-profit mission in expanding life-... ...following are detailed performance objectives for the Certified Nurse Midwife, who will need to be/become licensed in Texas and preferably...
NP Now
...A family feel, community hospital seeks an Part Time Radiologist in Greensburg, Indiana area!45 minutes from Cincinnati and Indianapolis... ...: Radiologist Comprehensive benefits package - health insurance, dental insurance, life insurance, and more Competitive...
Augusta University
...position) Pay Band: B8 Salary Range: $45,400/annually - $55,000/annually Salary to be commensurate with qualifications of the selected candidate within the established range (generally minimum-midpoint) of the position. Recruitment Period: 12/22/25 - Until...
Project 180
Title: Addiction Specialist (I-III) Division : Project 180 Pay Scale: $25.24-$30.62/hour Program: Project Based Housing (PBH) The Organization SSG-Project 180 turns lives around through innovative, wraparound services that keep people out of institutions...