Deine IT-Job-Welt

25 km

Informationen zur Anzeige:

(Senior) Data Engineer - IoT (m/f/d)
Aktualität: 08.06.2024


08.06.2024, AP Sensing GmbH
(Senior) Data Engineer - IoT (m/f/d)
You will work on the development of our hybrid (Cloud and Edge) IoT data infrastructure (Data Lake and MLOps). You will work on building a robust and scalable data catalogue to effectively manage metadata. This includes understanding and implementing best practices for data governance, management, and accessibility. You will work on a highly efficient storage layer to handle large amounts of sensor data (petabytes). The focus is on ensuring data integrity, speed, and scalability. In close collaboration with relevant teams and stakeholders, including Data Science, Operations and Business, you will perform the necessary requirements engineering. In close collaboration with other Data Engineers, ML Engineers, and Software Engineers, you will translate our business challenges into scalable data architectures. As an expert in our Data Engineering team, you will maintain your knowledge of current technologies, future trends and innovative methods through continuous training, cross-industry networking, and conference attendance.
You have a technical degree, ideally in computer science. You have at least 2 years of professional experience in data engineering, ideally in the field of big data, IoT and the management of sensor data for data analysis and ML. You have excellent knowledge of state-of-the-art storage technologies and their productive use (no SQL, time series databases, document stores, graph databases, etc.). You have sound programming skills in development with Python or other programming languages Experience with containerization (Docker and Kubernetes) You have excellent analytical skills and a very quick grasp. In-depth knowledge of AI workloads and MLOps. Ideally, you have good knowledge of at least one major cloud platform (AWS, GCP or Azure) and understand how to use the services optimally. You are familiar with stream processing technologies (Apache Flink, Spark, Storm, or Kafka).




(Senior) Data Engineer - IoT (m­­/­­f­­/­­d)