DESCRIPTION

• Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, Time series data, SAP and a lot other based on various proprietary systems. You will need to research and implement data ingestion with help of Big Data technologies
• Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part business logic and implement it using any language which supported by base data platform

REQUIREMENTS

• Advanced knowledge one of language: Java, Scala, Python, C#
• Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow
• Google Cloud Platform, Amazon Web Services, Cloudera (or any other) HADOOP distribution, Databricks

NICE TO HAVE

• Spark Streaming
• Kafka Streaming / Kafka Connect
• Snowflake
• ELK Stack
• Docker / Kubernetes
• Cassandra / MongoDB
• CI/CD: Jenkins, GitLab, Jira, Confluence other related tools

WE OFFER

• Vast opportunities for self-development: online courses and library, experience exchange with colleagues around the world, partial grant of certification
• English language classes
• Polish language classes for Foreigners
• Career development center
• Unlimited access to LinkedIn learning solutions
• Possibility to relocate for short and long-term projects (ex. to USA or Switzerland)
• Benefit package (private insurance, health care, multisport, lunch tickets, and shopping vouchers, etc.)
• Possibility to be involved in an international project
• Remote work options
• Mentoring programs with experts that will help you to grow
• Discount on Apple products up to 10%
• Relocation package for foreign applicants relocating to Poland

Please note that only selected candidates will be contacted