All
Java
JS
Testers
Mobile
PHP
.Net
Python
DevOps
Other
All
All
Plum Research
Big Data Engineer6000 - 14000 PLNb2b
Plum Research Piastów 22, Szczecin30 days ago
Mid
remote
net/b2b
>20
aleja Piastów 22, Szczecin

PlumResearch is looking for a Data Processing Engineer who can help us maintain existing systems, and develop new and effective solutions for processing our Big Data.


We’re looking for an engineer whose primary goal will be working closely with the current team and management to support and develop our existing system of gathering and processing Big Data. You’ll be joining a growing team that is excited about technology, scalability, and sharing our extensive knowledge with you. We’re particularly interested in engineers who have a talent for developing unconventional, fully-operational solutions. A successful candidate has strong analytical and programming skills alongside the ability to diagnose and solve functional and performance problems.


On a day-to-day basis you will:

  • maintain and improve existing pipelines, add new data processing pipelines in Airflow
  • optimize pipelines for handling large amounts of data
  • actively participate in choosing methods for solving any technological problems


We’d also love to see, but don't require experience with:

  • Kubernetes / Docker
  • Jenkins CI / Gitlab CI
  • ClickHouse
  • Designing and building data pipelines using any of (but not limited to) the following: Kafka, Spark, NoSQL, Hadoop/HDFS/Hive, Flink, Druid or their cloud alternatives

Reporting to: VP of Engineering


The hiring process is executed in collaboration with the Red Sky team

We expect:
3–4 years of experience in a similar role
Ability to write modular and testable code
Experience with Unit tests and Linux
Communicative spoken and written English
We offer:
Competence Day
Free Books
Remote Conferences & Industry Events
Leadership & Professional Development
Life Insurance, Medicover, Multisport
Requirements:
Python 3 (Pandas)
Mid
PostgreSQL / MySQL
Mid
Cassandra
Mid
Airflow
Mid
Knowledge of large data set processing
Mid
Good to know
Nie poddawaj się zbyt szybko. Pamiętaj, że czas odpowiedzi rekrutera może się różnić.