Data Engineer (Mid-Senior)
3310-6950
€/mon.
Gross
„Unicorns Lithuania“ asociacijos narys
Į rankas per mėn.
Vilnius
- Oxylabs
We are a market-leading web intelligence collection platform, providing premium proxies and data scraping solutions for large-scale public web data gathering. Today, we unite over 450 data industry professionals for one purpose: to create a future where all businesses have access to big data and business intelligence, and a work environment where everyone can grow and thrive.
Here's how our Data Team describes this position:
If you joined this team, you would be solving our clients’ most ambitious challenges - as we are reaching towards being one of the first data extraction services!
We value people hungry for knowledge and eager to apply it, and in return, we provide a constantly evolving environment rich with challenges that we solve with the latest technologies and greatest ideas. We have a seat ready for you!
Here's how our Data Team describes this position:
If you joined this team, you would be solving our clients’ most ambitious challenges - as we are reaching towards being one of the first data extraction services!
We value people hungry for knowledge and eager to apply it, and in return, we provide a constantly evolving environment rich with challenges that we solve with the latest technologies and greatest ideas. We have a seat ready for you!
Your day-to-day:
- Work with challenging tasks to maintain data that helps our clients gain insights on various aspects of our system.
- Work on our data platform to enable building and delivering large datasets to final clients.
- Collaborate with the back-end team to ensure smooth data pipelines and processing.
- Work with data extraction services and build tools for it.
- Build data models and implement necessary modifications.
- Understand big data processing principles.
- Design, implement, manage, test, monitor, and optimize our data platforms to meet the data pipeline needs.
- Identify incomplete data, improve the quality of data, and integrate data from several data sources.
Your skills & experience:
- Experience building data pipelines using cloud service providers such as Amazon Web Services (AWS), Microsoft Azure or Google Cloud Platform (GCP).
- Strong experience using any of the cloud providers. We use GCP ideally would like GCP but AWS and Azure would be also valid.
- Experience with Apache Spark and/or its Python libraries.
- Knowledge of ETL/ELT pipeline design for semi-structured data (both batch and real-time), development and maintenance using SQL and/or Python.
- Experience with SQL and NoSQL approaches to database design for evolving schemas, preferably in context of a large data lake or data warehouse (e.g. Google Cloud Storage/Google BigQuery), optimized for either storage or retrieval.
- Experience setting up and maintaining scheduled data processing orchestration (e.g. Airflow, Dagster).
- Experience developing and maintaining the infrastructure and tools around the data pipeline is highly desirable (e.g. managing AWS resources via Terraform, setting up CI/CD, maintaining a Kubernetes cluster).
NICE TO HAVE:
- Experience working with dbt and Great Expectations is a plus.
- Experience working with or implementing Data Catalogs is a plus.
- Experience with REST API development is a plus.
- Experience with any of the messaging systems (such as Pub/Sub, RabbitMQ, AWS Kinesis or Apache Kafka) is a plus.
Don't hesitate to apply even if you missed some of the criteria!
Salary:
- Gross salary 3310 - 6950 EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competences.
The rest is on us:
- Growth: Turn your experience into a personal career journey through internal and external training, a books library, training platforms, online courses and mentorship;
- Travel: Get a taste of the world by attending conferences and business trips from Silicon Valley to the Middle East;
- Comfort: Hybrid work, offices based in the heart of Vilnius & Kaunas, and the ability to travel the world while working;
- Well-being: Private health insurance, on-site gyms, personal coaches, and other mental and physical well-being benefits help you stay fresh and steady;
- Celebrations: Extra vacation days & gifts for special occasions and the years spent with us;
- Team building: Regular internal events, quarterly team buildings, workshops, team retreats & workation trips;
- Office perks: Fully stocked kitchens, PS5, Foosball, ping-pong, Friday bun tradition, Mixtape Fridays & more;
- Tech: Bringing you the latest in technology, software, and gadgets to make your workday as smooth as possible;
- Bonus: Referral bonuses, discount offers and more. Much more;
Salary
3310-6950 €/mon. gross
Oxylabs
WHO WE ARE
Oxylabs is an international, industry-leading B2B tech company, providing tools and resources for web data gathering. Our mission is to ensure that every company, big or small, has access to data. It is our belief that data gathering should be important for every business seeking success.
OUR PRODUCTS
We offer a wide range of proxies and data gathering solutions. Our products are used for market research, e-commerce, ad verification, brand protection, travel fare aggregation and more.
OUR PEOPLE
At Oxylabs, we are building a team of talented and driven professionals. While working with top tier cutting-edge technology, it is necessary for everyone in the team to be creative and innovative – and so we are!
Žiūrėti visus šios įmonės skelbimus (20)
Oxylabs is an international, industry-leading B2B tech company, providing tools and resources for web data gathering. Our mission is to ensure that every company, big or small, has access to data. It is our belief that data gathering should be important for every business seeking success.
OUR PRODUCTS
We offer a wide range of proxies and data gathering solutions. Our products are used for market research, e-commerce, ad verification, brand protection, travel fare aggregation and more.
OUR PEOPLE
At Oxylabs, we are building a team of talented and driven professionals. While working with top tier cutting-edge technology, it is necessary for everyone in the team to be creative and innovative – and so we are!