Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...DIRECT HIRE | SENIOR COMMODITY BUYER | DeKalb, IL Industrial manufacturer is seeking a Senior Commodity Buyer, focusing on Maintenance... ...on experience Office Monday - Thursday (8-5 or similar), Remote work on Friday Full suite of benefits, healthcare, 401K, PTO,...
...complex products for the prevention and detection of possible fraud. Key responsibilities include researching and analyzing of account... ...Communications Adaptability Business Intelligence Investigation Management Issue Management Relationship Building...
Software Engineer (BMS) Location New York, NY : Software Engineer - Building Automation Systems Are you a problem solver who enjoys a challenge? Do you possess HVAC or digital controls experience? If yes, come work as a Software Engineer at a dynamic company that offers...
...healthcare services while addressing the social determinants of health that impact our patients lives. About the Role We are looking... ...health, outreach, or similar fields. Coursework in public health or community health. Nice to Have but Not Necessary...
$35-$45/hourSummary Objective:Create and deliver a variety of personal training workouts for a wide range of clients. Build a client base, and recruit new personal training clients under the management of the Fitness Director and with the Personal Training team.Essential...