Lead Data Engineer

Location: Hyderabad
Department: Data
Posted:

About You

As a Lead Data Engineer you are enthusiastic about using data technology to solve business problems. This opportunity is a great fit, if you have data & software development skills and eager for an opportunity to build & maintain a cloud native, enterprise-scale data, analytics and ML systems. You have an agile mindset, aiming to deliver business value in increments. Work alongside other data engineers, data scientists and Product Managers in order to quickly productionize high quality analytical & ML applications.

Some of the things you’ll be doing: 

  • Build data ingestion services for the purpose of importing data from numerous, disparate data sources, inclusive of APIs, logs, relational, and non-relational databases and stream sources.

  • Design, develop and implement data pipelines for extraction, processing, and analysis of data using python scripts, spark and other data processing tools.

  • Develop & maintain Data Platform and all the related tools and infrastructure

  • Implement best practices for data management in Datalake & DWH.

  • Evolve & Optimize data platform architecture for better scale, performance, data access & self service for all users.

  • Work with data analysts and data scientists to ensure that all data feeds are optimised and available at the required times. This can include Change Capture, Change Data Control and other “delta loading” approaches

  • Automate DataOps and strive to upkeep and better SLAs.

  • Evangelize CI/CD, DevOps practices in the data & analytics community.

  • Apply, help defining, and championing data warehouse governance: data quality, testing, coding best practises, and peer review

You’ll be a great fit if:

  • You have extensive development experience in Python, spark, Kafka/Kinesis or other streaming services

  • You have experience in building data pipelines for both batch processes and streaming applications

  • You have experience in data mining, data warehouse solutions, and ETL, and using databases in a business environment with large-scale, complex datasets

  • You have experience architecting OLAP databases

  • You have extensive experience in writing SQL statements and performance tuning them

  • You have experience with with Snowflake, dbt, Apache Airflow, Python, Fivetran, AWS, git and Looker

  • You have experience working in a data engineering or data warehousing team

  • You have high development standards, especially for code quality, code reviews, unit testing, continuous integration and deployment

  • You have strong technical documentation skills and the ability to be clear and precise with business users

  • You have business-level of English and good communication skills

  • You have knowledge of various systems across the AWS platform and the role they play e.g. Lambda, DynamoDB, DMS, CloudFormation, Glue 

  • You have experience with Git and Docker

About Tide?

We’re the UK’s leading provider of smart current accounts for sole traders and small companies. We’re also on a mission to save business owners time and money on their banking and finance admin so they can get back to doing what they love – for too long, these customers have been under-served by the big banks.

Our offices are in London, UK, Sofia, Bulgaria and Hyderabad, India, where our teams are dedicated to our small business members, revolutionizing business banking for SMEs. We are also the leading provider of UK SME business accounts and one of the fastest-growing fintechs in the UK.

We’re scaling at speed with a focus on hiring talented individuals with a growth mindset and ownership mentality, who are able to juggle multiple and sometimes changing priorities. Our values show our commitment to working as one team, working collaboratively to take action and deliver results. Member first, we are passionate about our members and put them first. We are data-driven, we make decisions, creating insight using data.

We’re also one of LinkedIn’s top 10 hottest UK companies to work for.

What You’ll Get In Return

  • Competitive salary

  • 25 days holiday

  • Family medical Insurance

  • Enhanced family-friendly leave

  • Individual Training budget

  • Amazing work environment

Here’s What We Think About Diversity And Inclusion…

We build our services for all types of small business owners. We aim to be as diverse as our members so we hire people from a variety of backgrounds. We’re proud that our diversity not only reflects our multicultural society but that this breadth of experience makes us awesome at solving problems. Everyone here has a voice and you’ll be able to make a difference. If you share our values and want to help small businesses, you’ll make an amazing Tidean.

#LI-YA1