Big Data Engineer - Paris, France - Noveo Group

    Noveo Group
    Noveo Group Paris, France

    il y a 3 semaines

    Default job background
    Description

    We invite a Middle+/Senior Big Data Engineer (BigQuery, Dataflow) to join our development team.

    About us

  • On the market since 2002;
  • Operational department and development hubs worldwide.

    • Project description

  • Big-data project for collecting, processing and storing end-user data for AB-testing of applications (web, mobile). The project is based on the Google cloud platform (Dataflow, AppEngine, Kubernetes, BigQuery, BigTable, etc). It is being developed in the concept of microservice architecture with regular updates in production (CI/CD);
  • Average load: 30K requests per second, 1TB of new data per day;
  • The tasks include both the development of new functionality and bug-fixing, as well as the optimization of the current code, infrastructure, and development workflow.

    • Requirements

  • Fluent English (Upper-intermediate and above);
  • 3+ years of experience in commercial projects;
  • Good knowledge of Java (multithreading, generics, class-loading, Stream API);
  • Good knowledge of SQL databases (Big Query or ClickHouse), NoSQL databases, understanding of ETL, data warehouses;
  • Experience with messaging systems (GCP Pubsub, Kafka, SQS, AMQP, RabbitMQ...);
  • Understanding of distributed BigData systems, experience in performance optimization;
  • Understanding of object-oriented and functional programming principles;
  • Willingness to solve non-standard problems;
  • Location: GMT+1/max+3.

    • Desirable :

  • Knowledge of Python, Golang;
  • Experience with Google Cloud Platform (PubSub, Dataflow, Kubernetes, BigQuery, BigTable);
  • Knowledge of Apache Beam, gRPC, protobuf, Avro.

    • We offer

  • Employment is based on an employment contract of the country or a private entrepreneur contract without any reference to a specific location;
  • Paid vacations (24 working days/year) and sick leave;
  • Stable long-term workload (8 hours per day, 40 hours per week), flexible working hours, fully remote;
  • Working on exciting projects in an international team of professionals;
  • Opportunities for learning and practicing new technologies; internal training;
  • Participating in inner meetups and permanent experience exchange with colleagues;
  • Well-defined development processes and methodologies;
  • Partial reimbursement of medical fees, massage, or sports.

    • Recognise yourself? We are waiting for your CV