Remote Data Engineer Job at Axiom Software Solutions Limited, Remote

elBrU3NJemR5azJlWGppVUx1NkNkL1VXVFE9PQ==
  • Axiom Software Solutions Limited
  • Remote

Job Description

Job title: Data Engineer

Location: UK

Duration: 6-month contract Inside IR35

Working Mode: Fully Remote

Vetting: Active SC Clearance

Job Description:

Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively

Requirements

Required Skills:

Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA

Jobicy JobID: 125541

Job Tags

Full time, Contract work,

Similar Jobs

Mt. Zion United Methodist Church St. Louis

Audio/Visual (AV) Technician Job at Mt. Zion United Methodist Church St. Louis

 ...Job Summary: Mt. Zion United Methodist Church is seeking an Audio/Visual (AV) Technician to run the Mt. Zion UMC AV system for approximately a 2-hour period on Sunday mornings (9:00 am to end of service). Key Responsibilities: Gain proficiency with and effectively... 

Woodfield Country Club

Concierge/Front Desk Receptionist Job at Woodfield Country Club

 ...WoodfieldBoca Raton, is looking for an outgoing, energetic, and hospitality-driven professional who enjoys the art of service.Our Concierge will provide an excellent member experience and ensure a positive first and last impression to Members/Guests by offering prompt,... 

Talkiatry

Psychiatrist Job at Talkiatry

 ...with taking care of our doctors. We provide solutions to the challenges that psychiatrists are facing - from a lack of front and back-office infrastructure and support in private practice settings to being overworked and underpaid by hospitals, clinics, and other institutions... 

Guardian Tax

Call Center Sales Agent Job at Guardian Tax

 ...and monthly bonuses. Top reps hit $15K+ months. 100% Inbound Calls: No cold calling. Every lead is high-intent and ready to talk....  ...Preferred Backgrounds Tax Relief / Debt Settlement Call Centers Loans / Collections Real Estate Auto Sales Insurance Solar... 

Lingraphica

Content Writer Job at Lingraphica

 ...impairments. Welook for candidates who enjoyworking in a fast-paced, goal-oriented...  ...including web pages, guides,eBooks, email, social, paid media, video support, sales enablement, and...  ...Demands Incumbent works from home and is expected to maintain a safe, productive...