Summary
The customer is a market leader in digital payment security. It provides payment solutions to legal and professional service industries, as well as to marketplaces and eCommerce platforms. The company's clients include top-tier law firms and lenders with a total amount in transactions of over £3 billion.
The task is to build an analytics platform that is capable of supporting Data Analysts who produce predefined structured data outputs. This development includes AWS Glue and Amazon QuickSight. Data will come from the production platform sources, including Event Bus (SNS), Postgres Databases, Amazon CloudWatch, and various flat files in S3 buckets.
Responsibilities
- Seamlessly integrate and manage data across AWS and GCP. Your role will primarily focus on the Google ecosystem, utilizing tools such as BigQuery, Looker, and DocAI to optimize data processes;
- Design, construct, install, and maintain large-scale processing systems and other infrastructure. This includes ensuring data availability, tuning data pipelines, and setting up data architecture;
- Work closely with UI Engineers, Software Engineers, Architects, Analysts, and QA Testers to ensure data solutions are aligned with company objectives and are implemented in the broader system architectures;
- Explore and implement generative AI capabilities in the Google ecosystem, ensuring data solutions remain cutting-edge and provide meaningful insights;
- Automate manual processes where feasible, while understanding the nuances and importance of manual analysis;
- Engage in manual data evaluations and analyses, ensuring the proof of concept aligns with the intended design and meets business requirements;
- Foster a culture of knowledge sharing and mentorship within the team. Share best practices, challenges, and learnings in a collaborative environment.
Requirements
- Experience as a Data Engineer for 4+ years;
- Experience of designing, building or operating Data Warehouse, Data Lake or Lake-House solutions including data ingestion and replication, transformation and implementing solutions that use the resulting data for reporting and analytics;
- Experience with AWS or GCP, experience using BigQuery, Looker and DocAI;
- Experience including S3, Postgres, DynamoDB, Athena, Lake Formation, Lambda, Python, Redshift, Kinesis, CloudWatch, QuickSight, SNS and SQS (AWS Ecosystem);
- Experience including Cloud Storage, Dataflow/Dataprep, BigQuery, Cloud Functions, Cloud Monitoring, Datastream, Looker, Cloud Tasks (GCP Ecosystem);
- Understanding of the nuances of data structure, processing and management (Data-Centric Approach);
- Understanding of Agile methodologies (Scrum/Kanban);
- Understanding of the Serverless and Event-Driven concepts;
- Level of English – Upper-Intermediate.
Desired skills
- Experience in data modeling, profiling, and quality control in production systems;
- Experience in the financial services industry;
- Knowledge of best practices for data ingestion, storage (including tiering), file formats and structures such as Parquet, Avro, ORC;
- Experience in developing software using CI/CD;
- Certifications such as GCP Professional Data Engineer, AWS Big Data Speciality, AWS Data Analytics Speciality.
Reasons to join us
- Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc.;
- The opportunity to change the project and/or develop expertise in an interesting business domain;
- Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant;
- Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee;
- The opportunity to earn additional up to 1,700 EUR per month by participating in the company's activities;
- Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated;
- Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies);
- Certification compensation (AWS, PMP, etc);
- Referral program;
- English courses;
- Private health insurance and compensation for sports activities.
Join us!
$ads={2}
$ads={1}