Cutshort logo
Astegic logo
Senior Data Engineer
Astegic's logo

Senior Data Engineer

10 - 13 yrs
₹30L - ₹50L / yr
Remote only
Skills
skill iconScala
Apache Spark
Big Data
skill iconPython
skill iconJava
SQL
MySQL
databricks

POSITION:

Senior Data Engineer

The Senior Data Engineer will be responsible for building and extending our data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys working with big data and building systems from the ground up.

You will collaborate with our software engineers, database architects, data analysts and data scientists to ensure our data delivery architecture is consistent throughout the platform. You must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.


What You’ll Be Doing:

● Design and build parts of our data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources using the latest Big Data technologies.

● Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

● Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

● Work with machine learning, data, and analytics experts to drive innovation, accuracy and greater functionality in our data system.

Qualifications:

● Bachelor's degree in Engineering, Computer Science, or relevant

field.

● 10+ years of relevant and recent experience in a Data Engineer role.

● 5+ years recent experience with Apache Spark and solid understanding of the fundamentals.

● Deep understanding of Big Data concepts and distributed systems.

● Strong coding skills with Scala, Python, Java and/or other languages and the ability to quickly switch between them with ease.

● Advanced working SQL knowledge and experience working with a variety of relational databases such as Postgres and/or MySQL.

● Cloud Experience with DataBricks

● Experience working with data stored in many formats including Delta Tables, Parquet, CSV and JSON.

● Comfortable working in a linux shell environment and writing scripts as needed.

● Comfortable working in an Agile environment

● Machine Learning knowledge is a plus.

● Must be capable of working independently and delivering stable,

efficient and reliable software.

● Excellent written and verbal communication skills in English.

● Experience supporting and working with cross-functional teams in a dynamic environment.

REPORTING: This position will report to our CEO or any other Lead as assigned by Management.

EMPLOYMENT TYPE: Full-Time, Permanent LOCATION: Remote (Pan India) SHIFT TIMINGS: 2.00 pm-11:00pm IST

WHO WE ARE:

SalesIntel is the top revenue intelligence platform on the market. Our combination of automation and researchers allows us to reach 95% data accuracy for all our published contact data, while continuing to scale up our number of contacts. We currently have more than 5 million human-verifi ed contacts, another 70 million plus machine processed contacts, and the highest number of direct dial contacts in the industry. We guarantee our accuracy with our well-trained research team that re-verifi es every direct dial number, email, and contact every 90 days. With the most comprehensive contact and company data and our excellent customer service, SalesIntel has the best B2B data available. For more information, please visit – www.salesintel.io

WHAT WE OFFER: SalesIntel’s workplace is all about diversity. Different countries and cultures are represented in our workforce. We are growing at a fast pace and our work environment is constantly evolving with changing times. We motivate our team to better themselves by offering all the good stuff you’d expect like Holidays, Paid Leaves, Bonuses, Incentives, Medical Policy and company paid Training Programs.

SalesIntel is an Equal Opportunity Employer. We prohibit discrimination and harassment of any type and offer equal employment opportunities to employees and applicants without regard to race, color, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Astegic

Founded :
2002
Type :
Products & Services
Size :
100-1000
Stage :
Bootstrapped

About

Astegic offers a full range of mobile and IT services, from mobile app proof-of-concept development through full enterprise, cloud deployment strategies, implementation, and operational support. Our team is composed of experts in various areas including mobile solutions, enterprise IT services & operations, and UX & design. Click on each of our services below to learn…
Read more

Connect with the team

Profile picture
Nikita Pasricha
Profile picture
Tanu Priya
Profile picture
Pooja Sapra

Company social profiles

bloglinkedintwitterfacebook

Similar jobs

LetsIntern
at LetsIntern
1 candid answer
Ashish Singh
Posted by Ashish Singh
Remote only
0 - 1 yrs
₹12000 - ₹18000 / mo
Cyber Security
Manual testing

Join our Cybersecurity team to protect real-world systems from evolving threats through hands-on ethical hacking and defensive security.


What you'll do:

  • Conduct vulnerability assessments using Nmap, Nessus, OpenVAS
  • Perform penetration testing on web apps (Burp Suite, OWASP Top 10)
  • Analyze network traffic with Wireshark, set up SIEM alerts
  • Develop Python scripts for automated security scanning
  • Document findings in professional pentest reports
  • Work on LIVE client security audits (e-commerce, fintech)

What we need:

  • CS/IT/ECE background (1st-3rd year students welcome)
  • Basic Linux commands, networking fundamentals (TCP/IP)
  • Passion for cybersecurity; GitHub projects a plus
  • Tools exposure: Kali Linux, Metasploit (we'll teach advanced)

You'll gain:

  • Industry-recognized completion certificate
  • Portfolio-ready pentest reports
  • Live project experience for placements
  • Mentorship from certified ethical hackers


Read more
Recruitify
Anusha singh
Posted by Anusha singh
Bengaluru (Bangalore)
5 - 10 yrs
₹1L - ₹22L / yr
JIRA
confluence
Bitbucket
Perl
Groovy
+1 more
  • Create/modify scripts using a scripting language such as Perl and the Bitbucket REST API to disable users who have not logged in within a certain timeframe, and to monitor user project/repo permissions based on last commit date/time.
  • Every 3 months, run the Jenkins jobs to reprovision the Bitbucket test servers, verify Bitbucket functions properly, then plan and execute the reprovisioning of the production Bitbucket servers
  • Every 2 years, plan, install and deploy the latest Bitbucket version in our test environment, updating the Terraform code and Artifactory as required. Upgrade all plugins, test thoroughly, and work with various development teams to have them test as well. Once testing is complete and sign-off has been achieved, plan and run the Jenkins jobs to deploy the latest version of Bitbucket to the production servers.
  • Create scripts using a scripting language such as Perl and the Confluence and/or Atlassian Access REST API to disable users who have not logged in within a given amount of time
  • Good to have knowledge on BigPicture, EasyBI, Report2Web

Critical Skills to Possess:

  • 5+ years of experience in JIRA administration and Bitbucket 
  • Experience in Jira, Bitbucket application upgrade on data center.
  • Experience re-provisioning of Bitbucket using Jenkins.
  • Excellent in Groovy, Java scripting and Perl.
  • Experience in SSO implementation on Atlassian tool
  • Experience in Atlassian and third part application integration.
  • Strong problem solving and analytical skills to solve problems at their root.
  • Excellent time management and prioritization of tasks

Must have: ATLASSIAN PTY LTD Ver 7.17.0, Atlassian Cloud, ATLASSIAN PTY LTD Ver 8.6.1 Perl/Python, VB Script, Bitbucket REST API, Bitbucket SSH API, JQL

Good to have: Tomcat, Git, SourceTree, Linux, Terraform, Azure AD SSO, Oracle DB

Preferred Qualifications:

BS degree in Computer Science or Engineering or equivalent experience

 

Roles & Responsibilities

Roles and Responsibility:

1. Upgrade & Maintenance Expertise

  • Proven experience upgrading Jira and Bitbucket (Server or Data Center):
  • Integration with Jira and webhook/API-based automation
  • Perform pre-upgrade tests and staging environment setup
  • Apply patches, hotfixes, and troubleshoot upgrade failures.
  • YAML configuration for builds, tests, deploys.

2. System Administration

  • Proficiency with Linux/Unix OS (file systems, services, shell scripting)
  • Manage file permissions, processes, and system logs
  • Deep understanding of project configurations (schemes, workflows, screens, custom fields)
  • Advanced Jira workflow design (including conditions, validators, post-functions)
  • Automation using Groovy scripting 

3. Network Config, Authentication & Security

  • Manage SSL certificates, custom domains, and HTTPS configurations
  • Integration with LDAP / Active Directory and troubleshooting of SAML SSO (Okta, Azure AD, etc.)

4. CI/CD Pipelines (Bitbucket Pipelines):

  • Running pipeline for the OS remediation


Read more
Curl Analytics
Curl Analytics
Agency job
via wrackle by Naveen Taalanki
Bengaluru (Bangalore)
3 - 8 yrs
₹5L - ₹20L / yr
skill iconPython
skill iconDjango
RabbitMQ
Apache Kafka
skill iconDocker
+6 more
Job Description:

• As a Python full-stack developer, your role would involve design development and deploy full-stack applications out of Artificial intelligence projects with a focus on low latency and scalability.
• You also need to optimize the application for better performance and a large number of concurrent users.
• A strong technologist we care about doing things the right way rather than just doing them and thrives in a complex and challenging environment.

Who are we looking for?

• Bachelors / Masters in Computer Science or equivalent with at least 3+ years of professional experience.
• Solid understanding of design patterns, data structures, and advanced programming techniques
• As an Engineer in our team, you will design, code, test, and debug quality software programs.
• Strong software design and architectural skills in object-oriented and functional programming styles.
• Python, Celery, RabbitMQ, Kafka, Multithreading, Async, Microservices, Docker, Kubernetes.
• Experience in working with Machine Learning Pipelines
• Experience in Reactjs.
• Experience in Celery, RabbitMQ/Kafka.
• Experience in Unit Testing Tools.
• Experience in working with SQL & NonSql databases such as MySQL, Mongo DB.
• Exposure to cloud technologies.
• Demonstrate the ability to work in a fast paced and hyper-growth environment where the requirements are constantly changing.
• Nice to have: Experience developing products containing machine learning use cases.
• Familiar with agile techniques like code reviews, pair programming, collective code ownership, clean code, TDD and refactoring.
Read more
Zycus
at Zycus
10 recruiters
Sasi Vignesh
Posted by Sasi Vignesh
Remote only
10 - 15 yrs
₹40L - ₹50L / yr
skill iconMachine Learning (ML)
skill iconData Science
Natural Language Processing (NLP)
Computer Vision
recommendation algorithm

Zycus is looking for applicants with a strong background in Analytics and Data mining (Web, Social and Big data), Machine Learning, Pattern Recognition, Natural Language Processing, Computational Linguistics, Statistical Modelling, Inferencing, Information Retrieval, Large Scale Distributed Systems, Cloud Computing, Econometrics, Quantitative Marketing, Applied Game Theory, Mechanism Design, Operations Research, Optimization, Human Computer Interaction and Information Visualization. Applicants with a background in other quantitative areas are also encouraged to apply.


We are looking for someone who can create and implement AI solutions. If you have built a product like IBM WATSON in the past and not just used WATSON to build applications, this could be the perfect role for you.


All successful candidates are expected to dive deep into problem areas of Zycus’ interest and invent technology solutions to not only advance the current products, but also to generate new product options that can strategically advantage the organization.


Roles & Responsibilities:

  • Act as a technical thought leader in collaboration with the analytics leadership team, helping to set the strategy and standards for Machine Learning and advanced analytics
  • Work with senior leaders from all functions to explore opportunities for using advance analytics
  • Provide technical leadership, coaching, and mentoring to talented data scientists and analytics professionals
  • Guide data scientists in the use of advanced statistical, machine learning, and artificial intelligence methodologies
  • Guide the work of other Machine learning team members to provide support and assistance, while also ensuring quality


Read more
Chennai, Hyderabad, Bengaluru (Bangalore), Pune, Gurugram, Jaipur
5 - 10 yrs
₹10L - ₹24L / yr
skill iconJava
J2EE
skill iconSpring Boot
Microservices
skill iconAmazon Web Services (AWS)

Java with cloud

 

 Core Java, SpringBoot, MicroServices

- DB2 or any RDBMS database application development

- Linux OS, shell scripting, Batch Processing 

- Troubleshooting Large Scale application 

- Experience in automation and unit test framework is a must 

- AWS Cloud experience desirable 

- Agile Development Experience 

- Complete Development Cycle ( Dev, QA, UAT, Staging)

- Good Oral and Written Communication Skills

Read more
ZF india
Satish Kumar
Posted by Satish Kumar
Hyderabad
7 - 12 yrs
₹10L - ₹15L / yr
AUTOSAR
DCM
RTE
CAN
OS X

Role: AUTOSAR
Location: Hyderabad, IN
Fulltime


6 to 8 + Years’ experience

Skills Needs

Must Have

  • Experience in AUTOSAR (OS, COM, DCM, Mem & BswM)
  • Hands on experience in working with any one of the commercial AUTOSAT stack (EB/Vector/Mentor Graphics/KPIT stack)
  • Hands on experience in working with compiler settings, linker optimizations etc.
  • Hands on experience with any one of the design tools (EA/Rhapsody)
  • Hands on experience in working with requirement management tools, configuration management tools
  • Strong debugging skills
  • Should be proficient in using Trace32 debugger & writing scripts
  • Proficient in understanding arxml files and component integration
  • Experience/knowledge on OS, Multicore systems, RTE & Automotive ethernet protocol modules.
  • Experience/knowledge on UML is an added advantage
  • ADAS domain knowledge
  • Should be able to provide estimations for a work package and work with SW PM in preparing the project plan
  • Knowledge on ASPICE for SWE areas

 

Job R&R

Roles:

  • Provide overall SW Arch to team
  • Consider Consistency and reusability.
  • Assignment of ASIL to system elements.

Responsibilities:

  • Decompose into software functional components.
  • Analyze the critical path based on special requirement of certain categories (e.g. Safety, Security).
  • Define software component budgets for MCU resource (Runtime, RAM/ROM)
  • CPU Loading and calibration strategy.
  • Model the dynamic behavior
  • State Mechanism and time diagrams for operational mode.
  • Describe components and Interfaces.
  • Evaluate the design decisions and document their justifications for future maintenance.
  • Internal and external interfaces (physical, Functional and Contents) with reference to its specification in required database.
Read more
saahiHain
at saahiHain
1 video
1 recruiter
Arijit Mukherjee
Posted by Arijit Mukherjee
Remote only
1 - 5 yrs
₹10L - ₹20L / yr
MERN Stack
skill iconNodeJS (Node.js)
Electronic commerce
skill iconReact Native
skill iconReact.js
+3 more

About the job:

We are looking for a highly skilled computer programmer as a Tech-Cofounder who is comfortable with both front and back-end programming. You will be responsible for developing & designing a project/product from conception to final product, requiring good organizational skills and attention to detail.

 

Responsibilities:

  • Bridge functional abilities and other company's resources to improve efficiency.
  • Additionally, ensure collaboration between workers is easier and optimizes the company's inside IT processes/infrastructure.
  • Developing the product vision.
  • Designing user interactions on web pages. Selecting a technology stack, designing the application architecture, setting up a scalable cloud-based infrastructure (as well as choosing the cloud service provider), and testing the application.
  • Creating servers and databases for functionality. Make sure that the company's data is protected.
  • Ensuring cross-platform optimization for mobile phones.
  • Responsible for developing a minimum viable product (MVP) in the shortest time possible.
  • Ensuring responsiveness of app
  • Conception to finished product.
  • Designing and developing APIs.
  • Working alongside graphic designers for web design features.
  • Strong visualization to thoughtfully process business needs and mitigate those under core functionalities of the application.
  • Meeting both technical and consumer needs.
  • Staying abreast of developments in web applications and programming languages.

 

Requirements:

  • Strong organizational and project management skills with Product Management experience is desirable.
  • Proficiency with fundamental front-end languages such as HTML, CSS, and JavaScript.
  • Familiarity with JavaScript frameworks such as Angular JS, React, and Amber.
  • Proficiency with server-side languages such as Python, Nodejs.
  • Familiarity with database technology such as MySQL and MongoDB.
  • Good problem-solving & leadership skills.
  • Attention to detail.
  • A flawless executor with an entrepreneurial spirit.

 

Desired Skills and Experience:

  • Building cross-platform hybrid applications
  • Experience and knowledge in developing Ecommerce applications and video streaming.
  • Experience in MERN stack is a plus
  • Experience in deploying production ready codes
  • Experience in CI/CD pipelines
  • Previous working experience is not mandatory as long as you know how to build & move the ship.
Read more
AKS Interactive
Delhi
3 - 5 yrs
₹4.5L - ₹5.5L / yr
skill iconSwift
skill iconObjective C
skill iconiOS App Development
Xcode
Model-View-View-Model (MVVM)
+1 more
Hi,
 
Company  Link  -  https://www.aksinteractive.com/" target="_blank">https://www.aksinteractive.com/
 
https://www.google.com/search?q=aks+interactive+address&;ludocid=13232087711491661489&sa=X&ved=2ahUKEwjcudiD-I33AhWoTmwGHaiHDXkQ6BN6BAhcEAI" target="_blank">Address: B-1/ E-13,1st Floor, Mathura Rd, Block E, Mohan Cooperative Industrial Estate, New Delhi, Delhi 110044
 
As per our discussion please find the JD attached 

* 2 to 3 yr experience in iOS application development, design, and deployment for iOS devices
* Strong OOPs fundamental, Strong grasp of algorithms and data structures with good debugging skills.
* Must have good experience in Swift and have some knowledge of Objective-c.
* Awareness of Human Interface Guidelines (HIG) published by Apple for iPhone and iPad applications
* Familiarity with RESTful APIs to connect iOS applications to back-end services.
* Experience with iOS frameworks such as Core Data, Cocoa Touch, Core Animation, etc.
* Good experience in memory management techniques, code analysis, debugging, and profiling tools available within XCode.
* Knowledge of Size classes and Auto Layout.
* Experience with third-party libraries and APIs
* Hands-on experience with working on a design for iPhone and iPad Applications.
* Test, debug, analyze and fix application problems/issues.
* Must implement Payment Gateways.
* Must follow the latest design pattern(MVVM)
 
Good To Have
 
1. Knowledge of Flutter or React-native will be an advantage.
2. Good knowledge of working with git version control i.e. Github to upload and fetch Project data.
3. Good knowledge of working with postmen, Firebase Cloud Messaging( FCM)
4- Good knowledge of Google Map Apis
 
If you are comfortable, kindly share your updated resume
Read more
enterprise-grade, streaming integration with intelligence pl
enterprise-grade, streaming integration with intelligence pl
Agency job
via Jobdost by Mamatha A
Chennai
2 - 5 yrs
₹5L - ₹15L / yr
DevOps
skill iconDocker
skill iconKubernetes
CI/CD
skill iconGo Programming (Golang)
+13 more

Striim (pronounced “stream” with two i’s for integration and intelligence) was founded in 2012 with a simple goal of helping companies make data useful the instant it’s born.

Striim’s enterprise-grade, streaming integration with intelligence platform makes it easy to build continuous, streaming data pipelines – including change data capture (CDC) – to power real-time cloud integration, log correlation, edge processing, and streaming analytics

2 - 5 Years of Experience in any Programming any language (Polyglot Preferred ) & System Operations • Awareness of Devops & Agile Methodologies • Proficient in leveraging CI and CD tools to automate testing and deployment . • Experience in working in an agile and fast paced environment . • Hands on knowledge of at least one cloud platform (AWS / GCP / Azure). • Cloud networking knowledge: should understand VPC, NATs, and routers. • Contributions to open source is a plus. • Good written communication skills are a must. Contributions to technical blogs / whitepapers will be an added advantage.

Read more
NearePe
at NearePe
2 recruiters
Himanshu Garg
Posted by Himanshu Garg
Noida, NCR (Delhi | Gurgaon | Noida)
1 - 7 yrs
₹5L - ₹15L / yr
skill iconJava
J2EE
Hibernate (Java)
skill iconSpring Boot
We are enabling 500 million smartphone users in India to buy online by paying offline using a vast retailer network, working as local cash collection point. We are exposing this network as payment gateway api to online companies.
Check website :- http://nearpe.com
You are suppose to take care of all the technology requirements end to end. Our stack is in java+springboot+postgres, deployed on AWS with native android application. 

General requirements :-

- Design and build highly scalable java based transactional web applications.

- End to end responsibility of delivery of requirements within timeframe.

- Managing a team of 3-4 engineers.

- Direct interaction with internal and external clients to understand requirements and for integration purpose.

- Write clean, maintainable code with best standard practices.

- Participate in all phases of development including requirement gathering, development and deployment.

- Mentor & lead the team.

- Excellent Command over JAVA, DS, Algorithms, Postgres or similar RDBMS.

- Knowledge of full-stack development including Front end or Android native development is plus (not mandatory though).

- Good sense of customer behaviour, satisfaction and product development is required.

- Good sense of humor is must, along with beer every week :)

- At least 3-4 years of hardcore development experience with product companies along with managing small team.

Experience: 3+ years hands on experience in Java/J2EE development and programming.
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos