Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...include: flexible scheduling to accommodate lifestyle commitments, vacation, sick leave, medical, dental, sponsorship for Top Secret Clearance, comprehensive training, discounts on higher education and much more. Partner with us to begin a journey that begins with a...
...United States Employment Type Full time Location Type Remote Department Clinical Care About 9amHealth 9amHealth... ...document care in a telehealth setting.Our Clinical Care Pharmacists provide direct care and education to patients with chronic cardiometabolic...
...logistics. Bring your skills to an industry that offers stability and international career growth. We offer a great compensation and medical/dental benefits package, employee discounts, tuition reimbursement, excellent training programs, and a fun, and interesting global...
...Barista Bring the Energy, Serve the Fun!Hiring for all shifts! Looking for a fun and fast-paced job where you can bring your personality and energy to work? Are you an early riser, an afternoon go-getter, or someone who loves a busy weekend vibe? Join our coffee...
...- Excellent communication skills and a friendly demeanor. - Ability to work in a fast-paced environment while maintaining attention to detail. - Availability to work weekends and holidays (as needed). - Lifting and carrying items (such as trays, plates, and supplies...