Full time

Senior Data Engineer (Python) - REF1440

About Creative Software

Founded in 1999, Creative Software is a global technology enabler and pioneer in Sri Lanka’s tech industry. We manage teams of high-performing, dedicated software engineers for our global clientele, providing them with end-to-end software development and maintenance services through team augmentation.

About this position

We are looking for a Senior Data Engineer to join our Research and Development Centre in Colombo and be a part of our team of 300+ problem solvers who build brilliant tech, influencing billions of users globally.

It’s ideal if you are with:

  • Bachelor’s Degree in Computer Science/ Engineering/ Data Science/ Statistics or an equivalent qualification.
  • Minimum 3+ years of experience in a data-intense role with some software development background.
  • Strong understanding of data engineering and data science fundamentals.
  • Good knowledge of working with data technologies, such as ETL, SQL, and Python.
  • Python proficiency with experience in Pandas, Numpy, Matplotlib, Flask, and FastAPI libraries.
  • Experience with GitHub and GitActions (version control).
  • Hands-on experience with data visualization technologies such as Grafana/PowerBI/Streamlit (one or more).
  • Hands-on experience in IoT integrations will be an added advantage (OPCUA/MODBUS/PROFIBUS/MQTT).
  • Experience with cloud infrastructure services (Azure, GCP) is an advantage.
  • Competency in machine learning principles and techniques is an advantage.
  • Good understanding of container orchestration tools such as Kubernetes.
  • Good understanding of Agile software development practices (Scrum).
  • Experience with JavaScript is an advantage.
  • Very good communication skills in English, verbal, and written.
  • Ability to work on both internal and external client-facing projects and communicate with key stakeholders.
  • Willing to work irregularly (i.e., European hours)

It’s ideal if your expertise is to:

  • Work with Solution Architects and Subject Matter Experts (SME) to understand client requirements.
  • Develop new custom extractors using Python and deploy them in cloud infrastructure. This includes data discovery, preprocessing, and integration.
  • Manage and maintain custom data extractors using backend technologies and languages i.e. Python, Spark, and Rest APIs.
  • Author data transformations using SQL and manage DataOps pipelines.
  • Develop and manage custom data solutions including data pipelines and data visualization dashboards.
  • Develop and manage custom data models using Python for contextualizations.
  • Take ownership of work and keep up to date with project deadlines.
  • Build strong work relationships with the client's product management and development team.
  • Drive continuous improvement of software quality, customer experience, and maintainability of products/features.
  • Review team members’ code and provide constructive feedback.
Uploading...
fileuploaded.jpg
Upload failed. Max size for files is 10 MB.
Files must be less than 10 MB
Allowed file types: pdf, docx, doc, txt
Thank you! Your submission has been received!
Oops! Something went wrong while submitting the form.