Data Engineer
Networking & Cybersecurity Solutions
4 - 16 yrs
₹40L - ₹60L / yr
Bengaluru (Bangalore)
Skills
Spark
Apache Kafka
Data Engineer
Hadoop
Big Data
TensorFlow
Flink
"Numpy"
- Developing telemetry software to connect Junos devices to the cloud
- Fast prototyping and laying the SW foundation for product solutions
- Moving prototype solutions to a production cloud multitenant SaaS solution
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources
- Build analytics tools that utilize the data pipeline to provide significant insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with partners including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics specialists to strive for greater functionality in our data systems.
Qualification and Desired Experiences
- Master in Computer Science, Electrical Engineering, Statistics, Applied Math or equivalent fields with strong mathematical background
- 5+ years experiences building data pipelines for data science-driven solutions
- Strong hands-on coding skills (preferably in Python) processing large-scale data set and developing machine learning model
- Familiar with one or more machine learning or statistical modeling tools such as Numpy, ScikitLearn, MLlib, Tensorflow
- Good team worker with excellent interpersonal skills written, verbal and presentation
- Create and maintain optimal data pipeline architecture,
- Assemble large, sophisticated data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Experience with AWS, S3, Flink, Spark, Kafka, Elastic Search
- Previous work in a start-up environment
- 3+ years experiences building data pipelines for data science-driven solutions
- Master in Computer Science, Electrical Engineering, Statistics, Applied Math or equivalent fields with strong mathematical background
- We are looking for a candidate with 9+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
- Strong hands-on coding skills (preferably in Python) processing large-scale data set and developing machine learning model
- Familiar with one or more machine learning or statistical modeling tools such as Numpy, ScikitLearn, MLlib, Tensorflow
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and find opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Proven understanding of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Strong project management and interpersonal skills.
- Experience supporting and working with multi-functional teams in a multidimensional environment.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
Similar jobs
Bengaluru (Bangalore)
4 - 6 yrs
₹12L - ₹15L / yr
Python
DjangoPython DevOps,
Must have - Strong python
Must have - Strong python
· Must have - Familiarity with RESTful API development (Kafka).
Read more
Remote, Ahmedabad, Bengaluru (Bangalore), Mumbai
9 - 14 yrs
₹1L - ₹1L / yr
Project Management
Stakeholder management
Budget
Agile/Scrum
Project lifecycle management
Function: → Project Management
- Project Management
Responsibilities:
- Would be responsible for Program Management - Manage multiple challenging projects concurrently from initiation through execution and closure.
- Monitor project progress throughout the project life cycle, and communicate project status effectively to senior management through reports, presentations, and individual meetings.
- Build and provide direction to project teams, create and foster communication among team members
- Manage Kick- Meetings (geographical multi-vertical Fortune 1000 Global customers)
- Customer Engagement - coordinating with Internal and external stakeholders.
- Would enable Presales & Pilots for Tech Wins.
- Would support contract & SOW reviews & address prospect concerns during the sales process.
- Identify resource needs, constraints, and interdependencies.
- Capture and manage project risks and issues and associated mitigation strategies.
- Proactively engage other members and collaborate with the organization with specific subject knowledge to resolve issues or provide assistance.
- Monitor and control project budgets.
- Provide project management training, assistance, and mentoring on project management methodologies, tools, and techniques.
- Utilize analytical skills to make critical decisions and recommendations to solve project-related problems.
- Resource Planning & mentoring the internal team.
- Lead New Initiatives - Enable brainstorming sessions with the team to gather innovative approaches.
Requirements:
- Hands-on experience in project management roles and delivering multiple and complex projects.
- (Operations / Transitions / Migrations/ Supply Chain/ Procurement-S2P, P2P and S2C).
- Candidates having enterprise software background in the initial career phase and gradually moving to Project Management role.
- Experience in handling complex large projects and risk management.
- Excellent stakeholder management skills.
- Project artifacts Documentation and sign-off.
- Good at Team Management
- Excellent oral & written communication skills
- Should be proficient in client interactions.
Read more
Noida
3 - 8 yrs
₹6L - ₹15L / yr
NodeJS (Node.js)
MongoDBMongoose
Express
Amazon Web Services (AWS) +1 more
BlackLight Gaming is looking for a top-notch, ambitious and driven Node. js developer who is confident of creating, maintaining and further optimising highly scalable backend supporting our multiplayer mobile games which are played by millions of players. If you're hard-working, enthusiastic, dedicated, have fire in the belly to accept challenges, then BlackLight Games is the place for you.
What You Bring to the team:
- More than 3+ years of experience developing serverless applications using public cloud like Google Cloud/ AWS
- Knowledge of Node. js and frameworks available for it.
- Strong proficiency with JavaScript
- Understanding the nature of asynchronous programming and its quirks and workarounds.
- Distributed system development with an understanding of latency, scalability, scheduling, asynchronous programming, and reliability
- Understanding fundamental design principles behind a scalable application
- Experience with services common to serverless architectures, like: AWS Lambda, DynamoDB, IAM, Firebase Real Time Database, Google Cloud SQL, Cloud Tasks. It’s a bonus if you have worked on Google Cloud Project and Firebase.
- Solid Experience with NoSQL and SQL databases is required with proven experience of creating database schemas that represent and support business processes.
- Integration of multiple data sources and databases into one system.
- Experience with deploying, maintaining, debugging live systems, and end-to-end testing and analysis
- Experienced in creating micro-services based architectures, reusable components
- Experience building REST APIs and other common application architectures on the above services
- Experience building data processing pipelines
- Solid understanding of code, design, and development practices
- General comfort in exploring, assessing, and learning new frameworks
- High levels of integrity and professionalism, and an ability to channel maximum amounts of energy into the role delivering premium customer service at all times
- Adhere to different Project Management methodologies (Agile etc) and leverage different CI/CD tools
Extra Gems for:
- Google, AWS and/or Industry certifications.
- Familiarity with object storage such as AWS S3, Firebase Storage, in-memory caches such as Redis
- Demonstrated performance of threat modeling, risk assessment techniques, code reviews in the context of DevSecOps security
- Knowledge of Application Monitoring using tools like Google Stackdriver
- Broad familiarity with other languages like J2EE, Python as we write some code in these as well.
- Experience with Github and advanced Github features.
- Experience of working in Product industry
- Open source contributions, interesting hobby projects.
Why Us?
- High Growth Startup environment
- Company sponsored courses and education material
- Lots of learning opportunities
- Work with a super-talented team of professionals
- Informal work-culture, Casual Dress Code, multiple outings and trips
- Performance Based Bonus
- Competitive Salary
- Medical Insurance for you and your family
- Subsidies Lunch and Unlimited Snacks, Tea & Coffee in the house at all time
Read more
Bengaluru (Bangalore), Hyderabad
3 - 8 yrs
₹5L - ₹30L / yr
Device Driver Development
Linux kernel
Linux devise drivers Developer in Linux kernel envernivement
Skills: Device drivers, Linux kernel, Linux device drivers, U-boot, Scripting Like Shell Python and Yacto envernovelment
Read more
Remote only
2 - 6 yrs
₹2L - ₹16L / yr
React NativeCandidates having 2+ years of experience in react native can apply for this frontend role. Need immediate joiner with max 15 days notice period. This is a complete remote job,with health insurance benefits.
Read more
Hyderabad
3 - 10 yrs
₹10L - ₹15L / yr
Microsoft Dynamics CRM
Job Requirements:
- 3+ years of relevant experience
- Experience in Dynamics 365 CE customization including the development of plugins, workflows, web resources, security, and Portal development.
- JavaScript, jQuery experience.
- CRM API / SDK knowledge and 3rd party solutions integration experience.
- SharePoint integration experience.
- Configuring and customizing D365 CE first-party apps like sales, customer service, Field service.
- Managing Dynamics 365 integration with Azure services.
- D365 certifications
Read more
Agra
3 - 5 yrs
₹6L - ₹10L / yr
Java
ScalaApache Spark
Spark
Hadoop
+1 more
Major Accountabilities
Collaborate with the CIO on application Architecture and Design of our ETL (Extract, Transform,
Load) and other aspects of Data Pipelines. Our stack is built on top of the well-known Spark
Ecosystem (e.g. Scala, Python, etc.)
Periodically evaluate architectural landscape for efficiencies in our Data Pipelines and define current
state, target state architecture and transition plans, road maps to achieve desired architectural state
Conducts/leads and implements proof of concepts to prove new technologies in support of
architecture vision and guiding principles (e.g. Flink)
Assist in the ideation and execution of architectural principles, guidelines and technology standards
that can be leveraged across the team and organization. Specially around ETL & Data Pipelines
Promotes consistency between all applications leveraging enterprise automation capabilities
Provide architectural consultation, support, mentoring, and guidance to project teams, e.g. architects,
data scientist, developers, etc.
Collaborate with the DevOps Lead on technical features
Define and manage work items using Agile methodologies (Kanban, Azure boards, etc) Leads Data
Engineering efforts (e.g. Scala Spark, PySpark, etc)
Knowledge & Experience
Experienced with Spark, Delta Lake, and Scala to work with Petabytes of data (to work with Batch
and Streaming flows)
Knowledge of a wide variety of open source technologies including but not limited to; NiFi,
Kubernetes, Docker, Hive, Oozie, YARN, Zookeeper, PostgreSQL, RabbitMQ, Elasticsearch
A strong understanding of AWS/Azure and/or technology as a service (Iaas, SaaS, PaaS)
Strong verbal and written communications skills are a must, as well as the ability to work effectively
across internal and external organizations and virtual teams
Appreciation of building high volume, low latency systems for the API flow
Core Dev skills (SOLID principles, IOC, 12-factor app, CI-CD, GIT)
Messaging, Microservice Architecture, Caching (Redis), Containerization, Performance, and Load
testing, REST APIs
Knowledge of HTML, JavaScript frameworks (preferably Angular 2+), Typescript
Appreciation of Python and C# .NET Core or Java Appreciation of global data privacy requirements
and cryptography
Experience in System Testing and experience of automated testing e.g. unit tests, integration tests,
mocking/stubbing
Relevant industry and other professional qualifications
Tertiary qualifications (degree level)
We are an inclusive employer and welcome applicants from all backgrounds. We pride ourselves on
our commitment to Equality and Diversity and are committed to removing barriers throughout our
hiring process.
Key Requirements
Extensive data engineering development experience (e.g., ETL), using well known stacks (e.g., Scala
Spark)
Experience in Technical Leadership positions (or looking to gain experience)
Background software engineering
The ability to write technical documentation
Solid understanding of virtualization and/or cloud computing technologies (e.g., docker, Kubernetes)
Experience in designing software solutions and enjoys UML and the odd sequence diagram
Experience operating within an Agile environment Ability to work independently and with minimum
supervision
Strong project development management skills, with the ability to successfully manage and prioritize
numerous time pressured analytical projects/work tasks simultaneously
Able to pivot quickly and make rapid decisions based on changing needs in a fast-paced environment
Works constructively with teams and acts with high integrity
Passionate team player with an inquisitive, creative mindset and ability to think outside the box.
Collaborate with the CIO on application Architecture and Design of our ETL (Extract, Transform,
Load) and other aspects of Data Pipelines. Our stack is built on top of the well-known Spark
Ecosystem (e.g. Scala, Python, etc.)
Periodically evaluate architectural landscape for efficiencies in our Data Pipelines and define current
state, target state architecture and transition plans, road maps to achieve desired architectural state
Conducts/leads and implements proof of concepts to prove new technologies in support of
architecture vision and guiding principles (e.g. Flink)
Assist in the ideation and execution of architectural principles, guidelines and technology standards
that can be leveraged across the team and organization. Specially around ETL & Data Pipelines
Promotes consistency between all applications leveraging enterprise automation capabilities
Provide architectural consultation, support, mentoring, and guidance to project teams, e.g. architects,
data scientist, developers, etc.
Collaborate with the DevOps Lead on technical features
Define and manage work items using Agile methodologies (Kanban, Azure boards, etc) Leads Data
Engineering efforts (e.g. Scala Spark, PySpark, etc)
Knowledge & Experience
Experienced with Spark, Delta Lake, and Scala to work with Petabytes of data (to work with Batch
and Streaming flows)
Knowledge of a wide variety of open source technologies including but not limited to; NiFi,
Kubernetes, Docker, Hive, Oozie, YARN, Zookeeper, PostgreSQL, RabbitMQ, Elasticsearch
A strong understanding of AWS/Azure and/or technology as a service (Iaas, SaaS, PaaS)
Strong verbal and written communications skills are a must, as well as the ability to work effectively
across internal and external organizations and virtual teams
Appreciation of building high volume, low latency systems for the API flow
Core Dev skills (SOLID principles, IOC, 12-factor app, CI-CD, GIT)
Messaging, Microservice Architecture, Caching (Redis), Containerization, Performance, and Load
testing, REST APIs
Knowledge of HTML, JavaScript frameworks (preferably Angular 2+), Typescript
Appreciation of Python and C# .NET Core or Java Appreciation of global data privacy requirements
and cryptography
Experience in System Testing and experience of automated testing e.g. unit tests, integration tests,
mocking/stubbing
Relevant industry and other professional qualifications
Tertiary qualifications (degree level)
We are an inclusive employer and welcome applicants from all backgrounds. We pride ourselves on
our commitment to Equality and Diversity and are committed to removing barriers throughout our
hiring process.
Key Requirements
Extensive data engineering development experience (e.g., ETL), using well known stacks (e.g., Scala
Spark)
Experience in Technical Leadership positions (or looking to gain experience)
Background software engineering
The ability to write technical documentation
Solid understanding of virtualization and/or cloud computing technologies (e.g., docker, Kubernetes)
Experience in designing software solutions and enjoys UML and the odd sequence diagram
Experience operating within an Agile environment Ability to work independently and with minimum
supervision
Strong project development management skills, with the ability to successfully manage and prioritize
numerous time pressured analytical projects/work tasks simultaneously
Able to pivot quickly and make rapid decisions based on changing needs in a fast-paced environment
Works constructively with teams and acts with high integrity
Passionate team player with an inquisitive, creative mindset and ability to think outside the box.
Read more
Pune
3 - 10 yrs
₹12L - ₹55L / yr
JavaJ2EE
Struts
Spring
Hibernate (Java)
+1 more
Roles and Responsibilities
• Code, develop, design and architect features related to the existing application. We
expect you to own modules end to end and take pride in the work products you
ship.
• Lead from the front, when it comes to delivering high quality work products. Serve
as a mentor to the team members
• Create and define performance metrics. Ideate, innovate and hack through the
existing systems to improve performance.
• Perform code reviews, set coding practices and guidelines within the team.
• Make sense of the product specs, be nimble in getting the issues resolved. Be a
thought leader.
Critical Functional Skills:
• Solid understanding and knowledge of Java/C/C++. You should understand the
concepts of multithreading, I/O, messaging, instrumentation etc and their
implementation in Java/Any other Object-Oriented Language.
• Proficiency in the implementation of algorithms and the use of advanced data
structures to solve problems in computing. A solid foundation in the principles of
computer science is desired.
• Ability to write clean, modular, and loosely coupled code by the use of design
patterns.
• He/She should be able to break down and architect complex software systems. For
example- Build
• Cars Availability Engine for Ola.
• Strong decision-making ability
• Deep expertise in at least one programming language & tech stack.
• Substantial experience in building complex and scalable solutions.
• Strong object-oriented design skills, ability to apply design patterns, and an uncanny
ability to design intuitive module and class-level interfaces
• The ability to do deep problem solving and build elegant, maintainable solutions to
complex problems.
• Experience leading multi-engineer projects and mentoring junior engineers
• Experience with full life cycle development in any programming language on a Linux
platform
• Comprehensive operational experience including, optimizations, deployments and
tuning servers like apache/mysql/tomcat/solr
• Prior experience in working with Agile software methodologies (XP, Scrum), TDD,
and Continuous Integration(CI/CD) a plus.
• Experience in building data-driven web application design and development is a plus
• Expert level experience in building a scalable, large and complex business
application.
Experience Required:
• Typically with an experience of 5+ years of development experience in a product
firm.
• Must have lead, designed, architected and delivered at least 1 project in his previous
assignments independently.
Minimum Qualifications Required:
• Btech/MS from a reputed Institute
• Deep expertise with any or combination programming languages: Java, C++, C#,
Ruby, Scala,
• Go any object-oriented high-level proprietary or open-source language with strong
programming constructs. We are not skill-specific but go by strength in
competencies
• Machine coding
• Single machine in-memory program
• Need a working code with functionality
• Readable and well-designed code with right abstractions, separation of concerns,
• right design patterns
• Performant code with concurrency and efficient data structures
• Write test cases covering the happy path and edge cases
• Problem Solving
• Choose the right combination of data structures to solve the problem
• Identify most edge cases for the problem
• Code, develop, design and architect features related to the existing application. We
expect you to own modules end to end and take pride in the work products you
ship.
• Lead from the front, when it comes to delivering high quality work products. Serve
as a mentor to the team members
• Create and define performance metrics. Ideate, innovate and hack through the
existing systems to improve performance.
• Perform code reviews, set coding practices and guidelines within the team.
• Make sense of the product specs, be nimble in getting the issues resolved. Be a
thought leader.
Critical Functional Skills:
• Solid understanding and knowledge of Java/C/C++. You should understand the
concepts of multithreading, I/O, messaging, instrumentation etc and their
implementation in Java/Any other Object-Oriented Language.
• Proficiency in the implementation of algorithms and the use of advanced data
structures to solve problems in computing. A solid foundation in the principles of
computer science is desired.
• Ability to write clean, modular, and loosely coupled code by the use of design
patterns.
• He/She should be able to break down and architect complex software systems. For
example- Build
• Cars Availability Engine for Ola.
• Strong decision-making ability
• Deep expertise in at least one programming language & tech stack.
• Substantial experience in building complex and scalable solutions.
• Strong object-oriented design skills, ability to apply design patterns, and an uncanny
ability to design intuitive module and class-level interfaces
• The ability to do deep problem solving and build elegant, maintainable solutions to
complex problems.
• Experience leading multi-engineer projects and mentoring junior engineers
• Experience with full life cycle development in any programming language on a Linux
platform
• Comprehensive operational experience including, optimizations, deployments and
tuning servers like apache/mysql/tomcat/solr
• Prior experience in working with Agile software methodologies (XP, Scrum), TDD,
and Continuous Integration(CI/CD) a plus.
• Experience in building data-driven web application design and development is a plus
• Expert level experience in building a scalable, large and complex business
application.
Experience Required:
• Typically with an experience of 5+ years of development experience in a product
firm.
• Must have lead, designed, architected and delivered at least 1 project in his previous
assignments independently.
Minimum Qualifications Required:
• Btech/MS from a reputed Institute
• Deep expertise with any or combination programming languages: Java, C++, C#,
Ruby, Scala,
• Go any object-oriented high-level proprietary or open-source language with strong
programming constructs. We are not skill-specific but go by strength in
competencies
• Machine coding
• Single machine in-memory program
• Need a working code with functionality
• Readable and well-designed code with right abstractions, separation of concerns,
• right design patterns
• Performant code with concurrency and efficient data structures
• Write test cases covering the happy path and edge cases
• Problem Solving
• Choose the right combination of data structures to solve the problem
• Identify most edge cases for the problem
Read more
Thrissur, Kodungallur
1 - 2 yrs
₹1L - ₹2L / yr
0066
Human Resources (HR)
Sourcing
Screening
Client Servicing
- 1-2 years of HR/IT Recruiter experience with excellent communication
- Excellent computer skills: Microsoft Office, Outlook and Internet
- Preferred both male and female candidates
Read more
Mumbai
1 - 2 yrs
₹1L - ₹2L / yr
Graphic Designing
HTML/CSSUser Experience (UX) Design
Adobe Photoshop
CorelDRAW
+2 more
We are looking for a young Creative Graphic designer with up-to-date knowledge to interpret our clients needs and design solutions with high visual impact. You will work on a variety of products, including websites, apps, marketing material, online promotions, product packaging, exhibitions, corporate identity etc.
Rits Software is a proprietorship firm based in Mumbai and we have been serving clients from different parts of the world with their technology requirements.
The primary services that we focus on are as below:
Web Development, Web portals.
Mobile Application Development - Android & iOS
Software Development - Custom Development as per client requirements
Our current focus has been on industries related to Travel, E-commerce, Medical Professionals, Health & Fitness, Animation & Retail.
Read more
Why apply to jobs via Cutshort
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
Follow CutshortUsers love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma
Full Stack Developer - AverlonI had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort