Sitecore Developer / Lead / Architect

Job Title: Data Engineer

Location: Pune, India

Experience: 5 to 9 years

Job Description:

We are seeking a talented and experienced Data Engineer to join our team in Pune. The ideal candidate will have a strong background in data engineering with expertise in Python, AWS, Spark, and Scala. This role is critical to our data infrastructure, ensuring that our data pipelines are robust, efficient, and scalable.

Required Skills:

• Python: Advanced proficiency with extensive experience in building data pipelines.
• AWS: Hands-on experience with AWS services such as S3, Lambda, Redshift, Glue, and EMR.
• Spark: Proficient in using Apache Spark for large-scale data processing.
• Scala: Working knowledge of Scala for Spark programming.
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with SQL and relational databases.
• Familiarity with data governance and security best practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Who We Are 🌟

We are a company where the ‘HOW’ of building software is just as important as the ‘WHAT’. Embracing Software Craftsmanship values and eXtreme Programming Practices, we create well-crafted products for our clients. We partner with large organizations to help modernize their legacy code bases and work with startups to launch MVPs, scale or as extensions of their team to efficiently operationalize their ideas. We love to work with folks who are passionate about creating exceptional software, are continuous learners, and are painstakingly fussy about quality. 

Our Values 💡

•Relentless Pursuit of Quality with Pragmatism

•Extreme Ownership

•Proactive Collaboration

•Active Pursuit of Mastery

•Effective Feedback

•Client Success 

What We’re Looking For 👀

We’re looking to hire software craftspeople and data engineers. People who are proud of the way they work and the code they write. People who believe in and are evangelists of extreme programming principles. High quality, motivated and passionate people who make great teams. We heavily believe in being a DevOps organization, where developers own the entire release cycle including infrastructure technologies in the cloud

What You’ll Be Doing 💻

Collaborate with teams across the organization, including product managers, data engineers and business leaders to translate requirements into software solutions to process large amounts of data.

• Develop new ways to ensure ETL and data processes are running efficiently.
• Write clean, maintainable, and reusable code that adheres to best practices and coding standards.
• Conduct thorough code reviews and provide constructive feedback to ensure high-quality codebase.
• Optimize software performance and ensure scalability and reliability.
• Stay up-to-date with the latest trends and advancements in data processing and ETL development and apply them to enhance our products.
• Meet with product owners and other stakeholders weekly to discuss priorities and project requirements.
• Ensure deployment of new code is tested thoroughly and has business sign off from stakeholders as well as senior leadership.
• Handle all incoming support requests and errors in a timely manner and within the necessary time frame and timezone commitments to the business.

Location : Remote

Skills you need in order to succeed in this role

What you will bring:

• 7+ years of experience with Java 11+(required), managing and working in Maven projects
• 2+ years of experience with Python (required)
• Knowledge and understanding of complex data pipelines utilizing ETL processes (required)
• 4+ years of experience using relational databases and deep knowledge of SQL with the ability to understand complex data relationships and transformations (required)
• Knowledge and understanding of Git (required)
• 3+ year of experience with various GCP technologies
• Google Dataflow (Apache Beam SDK) (equivalent Hadoop technologies)
• BigQuery (equivalent of any data warehouse technologies: Snowflake, Azure DW, Redshift)
• Cloud Storage Buckets (equivalent to S3)
• GCloud CLI
• Experience with Apache Airflow / Google Composer
• Knowledge and understanding of Docker, Linux, Shell/Bash and virtualization technologies
• Knowledge and understanding of CI/CD methodologies
• Ability to understand and build UML diagrams to showcase complex logic
• Experience with various organization/code tools such as Jira, Confluence and GitHub

Bonus Points for Tech Enthusiasts:

• Infrastructure as Code technologies (Pulumi, Terraform, CloudFormation)
• Experience with observability and logging platforms (DataDog)
• Experience with DBT or similar technologies
• 
  

Skills Required:

- Good experience with programming language Python
- Strong experience in Docker.
- Good knowledge with any of the Cloud Platform like Azure.
- Must be comfortable working in a Linux environment.
- Must have exposure into IOT domain and its protocols ((Zigbee & BLE ,LoRa,Modbus)
- Must be a good team player.
- Strong Communication Skills

LogiNext is looking for a technically savvy and passionate Junior Software Engineer - Data Science to analyze large amounts of raw information to find patterns that will help improve our company. We will rely on you to build data products to extract valuable business insights.

In this role, you should be highly analytical with a knack for analysis, math and statistics. Critical thinking and problem-solving skills are essential for interpreting data. We also want to see a passion for machine-learning and research.

Your goal will be to help our company analyze trends to make better decisions. Without knowledge of how the software works, data scientists might have difficulty in work. Apart from experience in developing R and Python, they must know modern approaches to software development and their impact. DevOps continuous integration and deployment, experience in cloud computing are everyday skills to manage and process data.

Responsibilities:

Identify valuable data sources and automate collection processes Undertake preprocessing of structured and unstructured data Analyze large amounts of information to discover trends and patterns Build predictive models and machine-learning algorithms Combine models through ensemble modeling Present information using data visualization techniques Propose solutions and strategies to business challenges Collaborate with engineering and product development teams

Requirements:

Bachelors degree or higher in Computer Science, Information Technology, Information Systems, Statistics, Mathematics, Commerce, Engineering, Business Management, Marketing or related field from top-tier school 0 to 1 year experince in in data mining, data modeling, and reporting. Understading of SaaS based products and services. Understanding of machine-learning and operations research Knowledge of R, SQL and Python; familiarity with Scala, Java or C++ is an asset Knowledge using business intelligence tools (e.g. Tableau) and data frameworks (e.g. Hadoop) Analytical mind and business acumen and problem-solving aptitude Excellent communication and presentation skills Proficiency in Excel for data management and manipulation Experience in statistical modeling techniques and data wrangling Able to work independently and set goals keeping business objectives in mind

Strong hands-on experience with ReactJS, Redux, TypeScript, HTML, Bootstrap, Material UI, CSS3/SCSS, Webpack, NPM, NVM, Visual Studio Code

Knowledge/Experience on Restful APIs integration.

Unit testing with Jasmine or an equivalent framework

Experience or Knowledge in developing complex reusable component libraries such as complex grids, spreadsheet components etc.,

Strong in UI/UX standards implementation

Understanding of browser fundamentals and Page Optimizations

Experience working with Git and Azure

• Strong first principles
• Hustle! We're young, lean, and in our early days. You'd have to set up your own shop, work with design customers to find generalizable use cases, and build them out.
• Ability to collaborate with cross-functional teams to build and ship new features
• At least 2-6 years of experience with primary exp in Python
• Must have skills - Flask / Django, RESTful Web Services, Database SQL / NoSQL
• The preferred Location is Bangalore but is also flexible with PAN India.
• Would require candidates from Tier 1 & 2 Companies or Tier 1 & 2 Colleges preferably.
• Proficient experience of back-end programming language - Python
• The preferred Location is Bangalore but is also flexible with PAN India.
• Would require candidates from Tier 1 & 2 Companies or Tier 1 & 2 Colleges preferably.