Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
...Job Summary: Mt. Zion United Methodist Church is seeking an Audio/Visual (AV) Technician to run the Mt. Zion UMC AV system for approximately a 2-hour period on Sunday mornings (9:00 am to end of service). Key Responsibilities: Gain proficiency with and effectively...
...WoodfieldBoca Raton, is looking for an outgoing, energetic, and hospitality-driven professional who enjoys the art of service.Our Concierge will provide an excellent member experience and ensure a positive first and last impression to Members/Guests by offering prompt,...
...with taking care of our doctors. We provide solutions to the challenges that psychiatrists are facing - from a lack of front and back-office infrastructure and support in private practice settings to being overworked and underpaid by hospitals, clinics, and other institutions...
...and monthly bonuses. Top reps hit $15K+ months. 100% Inbound Calls: No cold calling. Every lead is high-intent and ready to talk.... ...Preferred Backgrounds Tax Relief / Debt Settlement Call Centers Loans / Collections Real Estate Auto Sales Insurance Solar...
...impairments. Welook for candidates who enjoyworking in a fast-paced, goal-oriented... ...including web pages, guides,eBooks, email, social, paid media, video support, sales enablement, and... ...Demands Incumbent works from home and is expected to maintain a safe, productive...