Pyspark Developer

• Own and Maintain our interface. Built in Go, React and an event-driven architecture under the hood
• We work with complex data types and relations. Design our database (postgres) and maintain our S3 buckets.
• Build an infra which will work super-fast on cloud servers and runs reliably on-prem
• Develop a user-centric platform by helping us with ruthless prioritization of features
• Have an eye for detail especially when it comes to visual appeal
• 
  

What you bring to the table

• You have full-stack experience with relevant technologies (Go, React, Typescript)
• You know how to go from 0-to-1
• You have strong communication skills
• You thrive in a collaborative team setting

As a Python Engineer, you will play a critical role in building and scaling data pipelines, developing prompts for large language models (LLMs), and deploying them as efficient, scalable APIs. You will collaborate closely with data scientists, product managers, and other engineers to ensure seamless integration of data solutions and LLM functionalities. This role requires expertise in Python, API design, data engineering tools, and a strong understanding of LLMs and their applications.

Roles and Responsibilities:

● Design, architect, and drive implementation of entire products and key engineering features

● Plan and track the development and release schedules, and provide visible leadership in crisis

● Establish and follow best practices, including coding standards and technical task management

● Involve in the end-to-end architecture design and implementation

● Deal with a dynamic project or feature with changing requirements

● Recruit, motivate and develop a superior team, establish a clear definition of functional excellence and create a culture based on those practices

Experience and Skills you MUST have:

● Web application development and micro-services architecture using JavaScript, Python, and JavaScript libraries and ReactJs and other web technologies - HTML, CSS, and JS

● Experience with RDBMS or NoSQL Database technologies like MySQL, MongoDB, PostgreSQL, ElasticSearch, and Redis

● End to end deployment and DevOps using - Kubernetes, Docker, GCP Stack

● Knowledge of Jenkins, Prometheus, New Relic, and other tools

● Experience implementing testing platforms and unit tests

● Rock solid at working with third-party dependencies and debugging dependency conflict

Requirements:

·  Candidates must have substantial applicable IT experience, extensive development, programming experience in Core Java, J2ee, Spring, Spring Boot, Hibernate, Webservices using Restful, any DB (Oracle, PostgreSQL, SQL server).

·  Preferably the candidate must have worked in development projects and must have experience in Java / J2ee design patterns.

·  Experience in AWS, Azure will be an added advantage.

·  Candidate must have good experience in Agile methodology.

• 5+ years’ experience in customer focused product management in a technical product, end-to-end implementation and deployment within cloud systems.
• Must have experience in SaaS applications.
• Must have knowledge of Angular 8+, Azure, HTML CSS, JQuery, JavaScript ASP.Net, C#, SQL Server 2012/2014+ etc.
• Should have sound knowledge of Object-Oriented (OOPS) concepts.
• Must have experience in end-to-end product ownership and project management.
• Good experience in Relational Database Management Systems, Database design and Normalization.
• Hands-on experience in design, development, and debugging of systems.
• Object-Oriented Design (OOD) to ensure scalability and maintainability.
• Experience managing multiple clients with strong knowledge of Agile/SCRUM processes.
• Hands-on experience in DevOps and Azure functions.

KEY DUTIES AND RESPONSIBILITIES

·         Working on and at times leading the full software development lifecycle of systems

• Solid technical background with understanding and/or hands-on experience in software development, web technologies.
• Works with the product development team on the validation and verification process.
• Coordinate with the sales team to promote the product. 
• Experience of going through a full product lifecycle, integrating internal and external customer feedback into product requirements, managing change requests, driving prioritization and pre- / post-launch execution.
• Define product tasks and resource requirements.
• Analysis of systems, considering reliability, systems risks and code.
• Create technical and feature roadmaps along with release planning, sprint goals, and grooming of both technical and business functions.
• Manage project conflicts, challenges, and dynamic business requirements to meet expected deliverables.
• Experience in maintaining the document of application functionality.
• Excellent understanding of process management, improvement practices, operation services.
• Strong written and verbal communication skills.

The Data Engineering team is one of the core technology teams of Lumiq.ai and is responsible for creating all the Data related products and platforms which scale for any amount of data, users, and processing. The team also interacts with our customers to work out solutions, create technical architectures and deliver the products and solutions.

If you are someone who is always pondering how to make things better, how technologies can interact, how various tools, technologies, and concepts can help a customer or how a customer can use our products, then Lumiq is the place of opportunities.

Who are you?

• Enthusiast is your middle name. You know what’s new in Big Data technologies and how things are moving
• Apache is your toolbox and you have been a contributor to open source projects or have discussed the problems with the community on several occasions
• You use cloud for more than just provisioning a Virtual Machine
• Vim is friendly to you and you know how to exit Nano
• You check logs before screaming about an error
• You are a solid engineer who writes modular code and commits in GIT
• You are a doer who doesn’t say “no” without first understanding
• You understand the value of documentation of your work
• You are familiar with Machine Learning Ecosystem and how you can help your fellow Data Scientists to explore data and create production-ready ML pipelines

Experience

• At least 2 years of Data Engineering Experience
• Have interacted with Customers

Must Have Skills

• Amazon Web Services (AWS) - EMR, Glue, S3, RDS, EC2, Lambda, SQS, SES
• Apache Spark
• Python
• Scala
• PostgreSQL
• Git
• Linux

Good to have Skills

• Apache NiFi
• Apache Kafka
• Apache Hive
• Docker
• Amazon Certification

We are building for the future of work by changing the way the world looks at information and data paradigms. The Meaning Engine by India-based Needle Innovision enables building solutions by processing meaningful data out of anything stored anywhere - structured, unstructured data types, distributed, at scale and more. 

In our quest to do more, we are looking for a fantastic Java Tech Lead to join us in a hybrid setting from New Delhi. Below are some (seriously important) green flags that we are looking for from you: 

🟢 Ability to build and repeat the vision, not just work on tasks in the new phase of your career

🟢 The excitement to architect awesome products and resilient teams

🟢 Preparedness to move into enterprise-ready environments 

🟢 Build team motivation, delegate smartly and create a career path

This could be an awesome launching pad for someone who enjoys working towards big-picture goals, has a keen interest in leadership, and has a deep understanding of Java technologies.  Our teams are sustained on values of care and we offer a generous number of vacation days, the opportunity to craft your calendar with flexible schedules and very soon an insurance plan for you and your loved ones. We offer a starting salary range of 10-14LPA.

What you will do: 

• Collaborate with the client to understand problem statements and provide solutions for the same.
• Explain client requirements to the project team and plan and delegate work requirements
• Ensure the applications are released to production in the committed timeline
• Work with the QA team to ensure the code developed by the team passes the necessary quality check.
• Document application changes and development updates
• Set and evolve standards and best practices for our application development team 
• .Guide and mentor junior developers and engage in regular learning activities
• Oversee development process compliance and CI activities.

What you will bring: 

• 4 years minimum detail-oriented experience as a Senior Software Engineer.
• Experience in client interactions and/or are looking forward to doing that (preferred if, you have worked in B2B application development for large enterprises 🟢)
• Prior experience of at least one large project with a few people under your belt. (🟢)
• Expert-level knowledge of Java, Spring Boot, Oracle/Postgres.
• Expert-level knowledge on one or all of Hibernate/JPA/MyBatis.
• Experience in RESTful services and fundamentals of MVC architecture.
• Experience in working with and configuring web and application servers, such as Apache/Nginx/Tomcat.
• Proficient understanding of build tools, such as Maven/Gradle and code versioning tools, such as Git/SVN.
• Ability to review specifications documents and provide technical inputs on successfully implementing business solutions.

As a Java Tech Lead, you would be expected to understand business requirements, represent Needle to external stakeholders, and have experience in working in agile teams.

If leading a squad that implements digital transformation solutions at the intersection of data science and AI excites you, and if our awesome bite-sized team inspires you to be a part of our quest, we think you could be the one to help build the impact, we are looking to building here. 

Lets talk!