Data Engineer - Northern Ireland

Date Opened: Jan 25, 2019

Location: Belfast/Derry/Londonderry, Northern Ireland, United Kingdom

Company: Allstate Insurance Company


Belfast or Derry/Londonderry


Job Description

Founded by The Allstate Corporation in 2016, Arity is a data and analytics company focused on improving transportation. We collect and analyze enormous amounts of data, using predictive analytics to build solutions with a single goal in mind: to make transportation smarter, safer and more useful for everyone.

At the heart of that mission are the people that work here—the dreamers, doers and difference-makers that call this place home. As part of that team, your work will showcase both your intelligence and your creativity as you tackle real problems and put your talents towards transforming transportation.

That’s because at Arity, we believe work and life shouldn’t be at odds with one another. After all, we know that your unique qualities give you a unique perspective. We don’t just want you to see yourself here. We want you to be yourself here.


Arity Engineering

Our engineers are fueled by a passion to impact the future of mobility. They push the boundaries of telematics and transportation tech by creating and supporting cutting-edge products. As part of an Agile team, they are armed with the freedom to innovate and the opportunity to see projects through from start to finish. Using a variety of languages and a top-notch technology stack, our engineers make critical advances in areas like sensor technology, enterprise engineering and platform development. Our team understands what it means to collaborate and communicate in an interconnected global team, all while having trust, transparency and empathy for the end user. Which is pretty cool, if you ask us!


The Role

We are looking for an experienced Data Engineer, who is passionate about writing code to crunch data. Creating a ‘best in class’ technology solution that will save lives!


Arity Engineering is the place for you.


Responsibilities include (but aren't limited to):

  • Work closely with engineers, product managers, data scientists and data analysts to understand needs and requirements.
  • Implement and maintain data extraction, processing and storage processes in large scale data systems for analytics and reporting. 
  • Building the process and help define strategic direction to validate, enrich and process data which is then persisted.
  • Design, build, launch and support new data models and datasets in production. 
  • Recommend ways to improve data reliability, efficiency and quality
  • Define and manage SLA for datasets across the different storage layers.





Essential Criteria

  • Minimum of 4 years working experience in a software development role
  • Experience and knowledge of data technologies and a data engineering skill and mindset; preferably with experience in Big Data Technologies, e.g. Spark, Scala, Python, etc.
  • Strong working SQL knowledge and experience working with relational /Non-Relational databases (Oracle / Cassandra/others)
  • Good knowledge of data structures and data analysis tools
  • Experience in performing root cause analysis on data to provide insights, process, identify opportunities for improvement
  • Experience and knowledge on object-oriented concept and languages.
  • Good analytical skills related to working with a variety of datasets. 
  • Strong intuition for data with a keen aptitude on large scale data analysis.
  • Hands-on technical practitioner
  • Comfortable working in a paired development environment
  • Experience mentoring junior team members
  • Must be an EU citizen or possess a current UK Tier 1 Visa or Tier 2 visa and eligible to take up full time, permanent employment



Desirable Criteria

  • 3rd level qualification (IT preferable)
  • Working knowledge of Big Data querying tools, such as Pig, Hive, and Impala.
  • Working knowledge of Kafka, stream processing (spark streaming)
  • Working knowledge of ETL tools
  • Experience with Hadoop
  • Experienced in Spark architecture



Travel requirements:

Flexibility as required to meet business needs. As team establishes, potential for travel to downtown Chicago (Arity’s location in the Merchandise Mart) for 2 to 3 instances of up to 2 weeks.


On-call Requirements:

Flexibility as required to meet business needs




Closing Date:  Friday 22nd February 2019


Statement on Fair Employment and Equal Opportunities:

Allstate NI wishes to ensure equal opportunity is given to all job applicants.  This company will not discriminate on the grounds of race, gender (including gender reassignment status), sexual orientation, religious belief, political opinion, marital status, age or disability.


Applicants should note Allstate NI complete AccessNI background checks on all candidates offered a position.