Senior Scala Big Data Engineer
VirtusLab
Iasi, Romania
2 zile în urmă
source : Just Join IT

English (regular)

Hadoop or Cloud solutions (regular)

Spark (advanced)

Would you like to wrangle terabytes of data in minutes using cutting-edge technologies?

Would you like to join a team of talented and passionate Software Engineers?

Developing your programming skills, building and maintaining data lakes, data platforms and applications for various modern and highly-funded companies?

Using FP and type safety to make sure your applications are correct and do that in a company developing Scala 3?

If you are a Scala developer who would like to get into Big Data or a Data Engineer who wants to learn more about Scala (or both!) then we are looking for someone just like you.

If you're not yet fully convinced here's how the work at our company looks like through our team members eyes

You'll join the Data department at Virtuslab where we are providing Big Data and Machine Learning consulting services for various UK, EU and US clients.

Available Project :

1. A huge retailer, with tons of data stored in a large, on-prem Hadoop Cluster, which we're extending with cutting edge, flexible, cloud-based solutions.

We're responsible for creating large business aggregates for different e-commerce domains. Additionally, we cooperate with data scientists to optimise operations across a number of business areas (from van deliveries to in-store security).

Tech stack : Scala, Spark, Hadoop, Kafka, Kubernetes, Azure

2. Our main goal is to develop a generic Big Data ingestion and transformation framework for a new, highly funded, UK-based, insurance company.

We work across two teams : one responsible for developing the framework and extending the capabilities of the platform and another one focusing on using the framework to ingest hundreds of datasets from various data sources.

There are lots of greenfield areas and possibilities to impact the whole company.

Tech stack : Scala, Spark (mostly Core, some SQL), AWS (EMR, EC2, S3, Codebuild)

What & how?

  • On premise and cloud based infrastructures (project dependent, but Scala and Spark are the main technologies)
  • Professional and comprehensive monitoring, logging and alerting
  • Evolutionary Agile approach to software delivery
  • Great teamwork and knowledge sharing
  • Contributions to the open-source software communities
  • What we expect?

  • Ability and eager to lead by example
  • Hands-on experience in designing and development of scalable, distributed, highly available solutions
  • Interest in solving challenging data engineering problems using state-of-the-art techniques
  • Grounded knowledge and understanding of data structures, algorithms and distributed computing
  • Fluent with Scala and / or Spark
  • Functional Programming mind-set is a nice to have
  • Able to develop and maintain high-quality code
  • Can communicate with the business using good English (both written and verbal)
  • Experienced in using big data and cloud solutions (eg Hadoop, AWS, Azure)
  • Has a deep understanding of data-intensive distributed systems
  • What’s on offer?

  • Private healthcare
  • Stretching
  • Training package - every year you can use three working days for internal (Virtusity) or external training, we offer a full or partial refund
  • Funding of language lessons
  • Transparent rules of getting promoted - transparent environment that gives opportunities for personal growth, a promotion and a pay rise
  • Virtusity - in-house training division - knowledge sharing is an important part of our actions so we provide internal workshops and rich knowledge base
  • Building tech community in Poland - we create a space for the exchange of experience and ideas
  • Open source initiatives - we contribute to open source projects and enhance software that is used by software developers around the world
  • Flexibility in projects - we make a room for your autonomy and provide you with mentoring and guidance from the first day
  • Flexible hours - you decide when you work efficiently
  • Integration, sport events and tournaments
  • Office in the center of Kraków, Kielce or Rzeszów and soon in Katowice, Wrocław and Gdańsk !
  • Chillout zones
  • MacBook with all additional accessories needed
  • We do not expect you to qualify for all of the above points. A good understanding of some of these areas and a willingness to develop expertise in others may be sufficient.

    We are not concerned with your education or any other formalism. What we are concerned with are your passion, knowledge and experience.

    Raportați această lucrare
    checkmark

    Thank you for reporting this job!

    Your feedback will help us improve the quality of our services.

    Aplică
    Email-ul meu
    Făcând clic pe "Continuă", acord nevoo consimțământ de a procesa datele mele și de a-mi trimite alerte prin e-mail, așa cum este detaliat în policyApplicația de confidențialitate a lui neuvoo. Pot să-mi retrag consimțământul sau să mă dezabonez în orice moment.
    Continuă
    Formular