Data Engineer- Spark, SQL, Scala, Azure

At BigThinkCode, our technology solves complex problems. We are looking for full-stack engineer to join our Microsoft capability teams at Chennai.

Our ideal candidate will have expert knowledge of software development processes, programming and problem-solving skills. This is an opportunity to join a growing team and make a substantial impact at BigThinkCode.

Please see below our job description, if interested apply / reply by sharing your profile to discuss.

Company: BigThinkCode Technologies

URL: https://www.bigthinkcode.com/

Work location: Chennai (work from office)

Experience: 3 – 4 years

Programming skills required –

·      Proficiency in C#, .NET Core, MVC

·      Familiar with Data Structures & Algorithms, Object Oriented Programming basics.

·      Hands on Problem Solving and Debugging skills.

Framework required –

- EF Core

- Experience in OOJS, JavaScript, HTML, CSS, and at least one modern frontend framework like React/ Angular/ Vue.

Deployment and Devops basics required –

·      Cloud (AWS), Docker

·      Good to Have: Azure DevOps

Database required –

·      Relational (SQL Server), NoSQL, ORMs

Benefits:

·      Medical cover for employee and eligible dependents.

·      Tax beneficial salary structure.

·      Comprehensive leave policy

·      Competency development training programs.

Job Description

• Independently own one or more multiple modules, which includes: requirement analysis, design, development, maintenance & support
• Write extensive, efficient code to address complex modules and that handles interaction between multiple components.
• Rapidly iterate to add new functionalities and solves complex problems with simple and intuitive solutions
• Produce architecture with clean interfaces, that are efficient and scalable
• Participate and contribute to architectural discussions
• Perform design and code reviews
• Perform technical feasibility and trade off studies & guides others to perform these studies
• Solve production issues. Investigate and provide solutions to minimize the business impact due to outage
• Continuously improve performance metrics of modules you own.
• Collaborate effectively across teams to solve problems, execute and deliver results

Requirements

• 2+ years of relevant industry experience in MERN stack
• A deep understanding of JavaScript
• Experience working with SQL and NoSQL databases
• Experience with Unit and Integration tests
• Experience with CI/CD
• Experience with MathJax/Latex
• Experience with large scale video streaming

 2+ years of .NET Development experience

- Exceptional skills Experience with .NET,  technologies (WPF, Web Forms, .NET Core). Also skilled in MS SQL and PostgreSQL, Bootstrap and DevOps.

- Experience with DevExpress, Elasticsearch.Net, VS Studio is preferred SolarSearch

- Great business process understanding and written and verbal communication skills

- GitHub and Git experience.

JD for IOT DE:

The role requires experience in Azure core technologies – IoT Hub/ Event Hub, Stream Analytics, IoT Central, Azure Data Lake Storage, Azure Cosmos, Azure Data Factory, Azure SQL Database, Azure HDInsight / Databricks, SQL data warehouse.

You Have:

• Minimum 2 years of software development experience
• Minimum 2 years of experience in IoT/streaming data pipelines solution development
• Bachelor's and/or Master’s degree in computer science
• Strong Consulting skills in data management including data governance, data quality, security, data integration, processing, and provisioning
• Delivered data management projects with real-time/near real-time data insights delivery on Azure Cloud
• Translated complex analytical requirements into the technical design including data models, ETLs, and Dashboards / Reports
• Experience deploying dashboards and self-service analytics solutions on both relational and non-relational databases
• Experience with different computing paradigms in databases such as In-Memory, Distributed, Massively Parallel Processing
• Successfully delivered large scale IOT data management initiatives covering Plan, Design, Build and Deploy phases leveraging different delivery methodologies including Agile
• Experience in handling telemetry data with Spark Streaming, Kafka, Flink, Scala, Pyspark, Spark SQL.
• Hands-on experience on containers and Dockers
• Exposure to streaming protocols like MQTT and AMQP
• Knowledge of OT network protocols like OPC UA, CAN Bus, and similar protocols
• Strong knowledge of continuous integration, static code analysis, and test-driven development
• Experience in delivering projects in a highly collaborative delivery model with teams at onsite and offshore
• Must have excellent analytical and problem-solving skills
• Delivered change management initiatives focused on driving data platforms adoption across the enterprise
• Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations
   

Roles & Responsibilities
 

You Will:

• Translate functional requirements into technical design
• Interact with clients and internal stakeholders to understand the data and platform requirements in detail and determine core Azure services needed to fulfill the technical design
• Design, Develop and Deliver data integration interfaces in ADF and Azure Databricks
• Design, Develop and Deliver data provisioning interfaces to fulfill consumption needs
• Deliver data models on Azure platform, it could be on Azure Cosmos, SQL DW / Synapse, or SQL
• Advise clients on ML Engineering and deploying ML Ops at Scale on AKS
• Automate core activities to minimize the delivery lead times and improve the overall quality
• Optimize platform cost by selecting the right platform services and architecting the solution in a cost-effective manner
• Deploy Azure DevOps and CI CD processes
• Deploy logging and monitoring across the different integration points for critical alerts

• At least 4+ years experience in Angular.js / React.Js
• 4+ years of strong programming experience in UI/Web development using HTML5, CSS, JavaScript, and Bootstrap.
• 2+ years of strong programming experience in Unit Test Code Coverage using Jasmine / Karma.
• Strong in OOAD, design concepts & software engineering fundamentals.
• Strong inclination towards delivering quality software.
• Should be a good team player. Should have experience working in Agile Scrum Teams.
• Excellent communication skills
• Strong experience in defining & implementing software quality improvement measures: CI/CD setup, Jasmine, Karma Unit Testing
• Experience in working with tools like TFS, GIT.
• Should have strong problem-solving skills.

• Experience in UX will be good to have.

Experience & Background

• B-Tech/BCA/MCA
• 0-2 years of IT industry experience.
• Minimum 1 year of implementation/customization experience on ServiceNow
• ITIL/ServiceNow
  certifications will be an added advantage.
• Exposure on Service Now integration protocols with other application/systems
• Excellent attention to details, ability to multitask, and effective time management skills
• Knowledge of web based development languages; specifically JavaScript, Ajax
• Exposure of ITSM Framework and ITIL
• Good Communication Skills

We are the fastest growing SAAS platform in our segment. With offices in USA, UAE and INDIA we are focused on exponential growth over the next couple of years and we need rockstar team members who want to be part of this journey. We have over 12 positions open in tech such as Front end, Back end, Fullstack - MERN , UI/UX, ML and a lot more. 

Full Stack Developer 2+ yrs exp mandatory

Responsibilities:

• Architecting and developing backend web applications / APIs
• Backend integration with SQL/No-SQL databases, and other external services/APIs
• Integration of web application frontend and backend
• End-to-end performance and optimisation of the web/mobile application
• Frontend development of UI/UX using latest technologies and best practices
• Integrating external services to frontend for various needs
• Work with QA team to ensure test coverage and execution
• Create and automate unit test cases and conduct regular code reviews
• Work with business team to ensure application meets requirements and expectations of external and internal clients
• Work effectively in Agile environment
• Provide estimates and create user stories as part of agile methodology
• Work effectively with other members of same and external teams
• Work on multiple projects at the same time if need be

Requirements:

• Expertise in JavaScript based frontend and backend frameworks (MERN preferred)
• Expertise in AWS
• Expertise in developing full-stack JavaScript systems
• Experience in creating REST APIs
• Proficiency in working with Open source technologies is a plus
• Expertise in developing modern fluid web interfaces with latest technologies
• Experience with developing hybrid mobile apps
• Self-motivated and can work without much supervision
• Works well independently as well as in team environment
• Strong problem solving and analytical skills
• Excellent communication and interpersonal skills
• Experience working with international clients preferred
• Experience working with Git
• Experience with working on real time systems
• Experience working with SQL and non-SQL database systems
• Full Stack Development: 3 years + required

Java
J2ee
working experience with one or more clouds

Understanding of design architecture

Experience with Traditional databases and nosql databases

Sound in Algorithms,data structures and problem solving 

Good at coding and design