Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...to perform all duties and maintain knowledge of all standards and procedures as stated in each individual positions RCSH Employee Training Packet. Duties and Expectations: Maintain, clean and sanitize guest bathrooms throughout the evening after each use . ...
...Financial Officer (CFO) Supervises: Accounts Payable, Accounts Receivable, Payroll, Accounting Staff Position Overview The Accounting Manager is responsible for overseeing the daily accounting operations of the dealership in accordance with company policies and Generally...
...and timely. The HCA Patient Access Specialist communicates as appropriate with the physicians, NJ Medical Examiners, the Sharing Network, and Funeral Directors to ensure timely handling of deceased patients. Initiates electronic death record via NJ EDRS. Experience...
...and Experience: Bachelors degree in Engineering or Management And/ or 2 years of Management in Electronic Manufacturing of 4 or more employees Foxconn Assembly, LLC is an Equal Opportunity Employer (EOE). All qualified candidates will receive consideration...
...community. Job Description We are seeking a full time Retail Merchandiser for ourAsheville, NC territory. This role follows a... ...accuracy. Must live in assigned territory and be willing to travel throughout Must have valid driver's license, registered...