Cutshort logo
Spica Systems logo
Data Engineer - Python, Apache, Spark
Data Engineer - Python, Apache, Spark
Spica Systems's logo

Data Engineer - Python, Apache, Spark

Priyanka Bhattacharya's profile picture
Posted by Priyanka Bhattacharya
3 - 5 yrs
₹7L - ₹12L / yr
Kolkata
Skills
skill iconPython
Apache Spark
We are a Silicon Valley based start-up, established in 2019 and are recognized as experts in building products and providing R&D and Software Development services in wide range of leading-edge technologies such as LTE, 5G, Cloud Services (Public -AWS, AZURE,GCP,Private – Openstack) and Kubernetes. It has a highly scalable and secured 5G Packet Core Network, orchestrated by ML powered Kubernetes platform, which can be deployed in various multi cloud mode along with a test tool.Headquartered in San Jose, California, we have our R&D centre in Sector V, Salt Lake Kolkata.
 

Requirements:

  • Overall 3 to 5 years of experience in designing and implementing complex large scale Software.
  • Good in Python is must.
  • Experience in Apache Spark, Scala, Java and Delta Lake
  • Experience in designing and implementing templated ETL/ELT data pipelines
  • Expert level experience in Data Pipeline Orchestrationusing Apache Airflow for large scale production deployment
  • Experience in visualizing data from various tasks in the data pipeline using Apache Zeppelin/Plotly or any other visualization library.
  • Log management and log monitoring using ELK/Grafana
  • Git Hub Integration

 

Technology Stack: Apache Spark, Apache Airflow, Python, AWS, EC2, S3, Kubernetes, ELK, Grafana , Apache Arrow, Java

Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Spica Systems

Founded :
2019
Type :
Products & Services
Size :
20-100
Stage :
Raised funding

About

Spica Systems is a software company headquartered in San Jose, California with an R&D facility in Kolkata, India. Their mission is to build enterprise-grade 5G Packet Core and other necessary solutions to define a path to 5G for enterprises. They offer...
Read more

Connect with the team

Profile picture
Priyanka Bhattacharya

Company social profiles

linkedin

Similar jobs

Implement the best strategic solutions to businesses
Implement the best strategic solutions to businesses
Agency job
via Jobdost by Sathish Kumar
Hyderabad, Ahmedabad
9 - 20 yrs
Best in industry
skill iconAngularJS (1.x)
skill iconHTML/CSS
DevOps
skill iconNodeJS (Node.js)
skill iconReact.js
+3 more

Technology / Frame work: Angular, Ionic

 

Roles:

  • Design frontend architecture.
  • Provide solution for business needs.
  • 9+ years of experience in modern Javascript frameworks (Angular JS, Knockout, React) and other front end technologies (HTML5, CSS 3, Bootstrap)
  • Caching techniques such as Service workers to improve the front end performance.
  • Experience in unit testing automation frameworks such as Karma, Jasmine, Protractor.
  • Experience in optimization of UI for mobile & tablet devices for infinite & smooth scrolling.
  • Experience in Service side rendering technologies such as Angular 10. 0, typescript, React JS.
  • Experience in setting up DevOps & Continuous Delivery pipeline for front end technologies using a standard platform such as Jenkins, Puppet , Team City or IBM Urban Build.
  • Code quality measurement using automated tools as well as manual code reviews for Javascript technologies

Desired/Preferred Qualifications :

 

  • Bachelor's degree or equivalent experience
  • Strong problem solving and conceptual thinking abilities
  • Desire to work in a collaborative, fast-paced, start-up like environment.
  • Experience leveraging node.js frameworks such as Express.
  • Experience with distributed source control management, i.e. Git



Read more
Sigmoid
at Sigmoid
1 video
4 recruiters
Jayakumar AS
Posted by Jayakumar AS
Bengaluru (Bangalore), Hyderabad
2 - 5 yrs
₹12L - ₹15L / yr
PySpark
Data engineering
Big Data
Hadoop
Spark
+5 more

Sigmoid works with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software Development Engineer.


This position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to

spend a majority of their time coding.


Location - Bengaluru and Hyderabad


Responsibilities:

● Good development practices

○ Hands on coder with good experience in programming languages like Java or

Python.

○ Hands-on experience on the Big Data stack like PySpark, Hbase, Hadoop, Mapreduce and ElasticSearch.

○ Good understanding of programming principles and development practices like checkin policy, unit testing, code deployment

○ Self starter to be able to grasp new concepts and technology and translate them into large scale engineering developments

○ Excellent experience in Application development and support, integration development and data management.

● Align Sigmoid with key Client initiatives

○ Interface daily with customers across leading Fortune 500 companies to understand strategic requirements


● Stay up-to-date on the latest technology to ensure the greatest ROI for customer &Sigmoid

○ Hands on coder with good understanding on enterprise level code

○ Design and implement APIs, abstractions and integration patterns to solve challenging distributed computing problems

○ Experience in defining technical requirements, data extraction, data

transformation, automating jobs, productionizing jobs, and exploring new big data technologies within a Parallel Processing environment


● Culture

○ Must be a strategic thinker with the ability to think unconventional /

out:of:box.

○ Analytical and data driven orientation.

○ Raw intellect, talent and energy are critical.


○ Entrepreneurial and Agile : understands the demands of a private, high growth company.

○ Ability to be both a leader and hands on "doer".


Qualifications: -

- Years of track record of relevant work experience and a computer Science or related technical discipline is required

- Experience with functional and object-oriented programming, Java must.

- hand-On knowledge in Map Reduce, Hadoop, PySpark, Hbase and ElasticSearch.

- Effective communication skills (both written and verbal)

- Ability to collaborate with a diverse set of engineers, data scientists and product managers

- Comfort in a fast-paced start-up environment


Preferred Qualification:

- Technical knowledge in Map Reduce, Hadoop & GCS Stack a plus.

- Experience in agile methodology

- Experience with database modeling and development, data mining and warehousing.

- Experience in architecture and delivery of Enterprise scale applications and capable in developing framework, design patterns etc. Should be able to understand and tackle technical challenges, propose comprehensive solutions and guide junior staff

- Experience working with large, complex data sets from a variety of sources

Read more
Code Vyasa
mahima saxena
Posted by mahima saxena
Gurugram
2 - 4 yrs
₹8L - ₹12L / yr
skill icon.NET
skill iconC#
SQL server
ASP.NET
dot netcore
+3 more

Looking for DOT NET Developer| Gurgaon to join a team of rockstar developers. The candidate should have a minimum of 2+ yrs. of experience in {DOT NET}.


There are multiple openings. If you're looking for career growth & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into IIT'ans/BITS grads with 10+ years of development experience + work with F500 companies (our customers).


Company Background - CodeVyasa is a Software Product-Engineering and Development company that helps Early-stage & Mid-Market Product companies with IT Consulting, App Development, and On-demand Tech Resources. Our Journey over the last 3 years has been nothing short of a roller-coaster. Along our way, we've won some of the most prestigious awards while driving immense value to our customers & employees. Here's the link to our website (codevyasa.com). To give you a sense of our growth rate, we've added 70+ employees in the last 6 weeks itself and expect another 125+ by the end of Q4 2024


Requirements:

  •  Bachelor's degree in Computer Science, Information Technology, or related field .
  •  Minimum of 2 years of experience as a DOT NET Developer.
  •  Proficiency in { SQL SERVER, JQUERY, JAVA SCRIPT} development.
  •  Strong knowledge of {C#,DOT NETCORE} development.
  •  Aptitude for learning new technologies quickly.
  •  Good problem-solving and analytical skills.

What We Offer:

  •  Glassdoor rating of 4.8, indicating high employee satisfaction.
  •  Free healthcare benefits.
  •  Strong focus on upskilling and professional development opportunities.
  •  Diverse and inclusive work environment.
  •  Competitive compensation and benefits package.
  •  Emphasis on maintaining a healthy work-life balance.


Read more
Data Semantics
Deepu Vijayan
Posted by Deepu Vijayan
Remote only
4 - 8 yrs
Best in industry
skill icon.NET
ASP.NET
skill iconC#
SQL

Data Semantics 


We are Product base company and Microsoft Partner

Data Semantics is an award-winning Data Science company with a vision to empower every organization to harness the full potential of its data assets. In order to achieve this, we provide Artificial Intelligence, Big Data and Data Warehousing solutions to enterprises across the globe. Data Semantics was listed as one of the top 20 Analytics companies by Silicon India 2018 & CIO Review India 2014 as one of the Top 20 BI companies.  We are headquartered in Bangalore, India with our offices in 6 global locations including USA United Kingdom, Canada, United Arab Emirates (Dubai Abu Dhabi), and Mumbai. Our mission is to enable our people to learn the art of data management and visualization to help our customers make quick and smart decisions. 

 

Our Services include: 

Business Intelligence & Visualization

App and Data Modernization

Low Code Application Development

Artificial Intelligence

Internet of Things

Data Warehouse Modernization

Robotic Process Automation

Advanced Analytics

 

Our Products: 

Sirius – World’s most agile conversational AI platform

Serina

Conversational Analytics

Contactless Attendance Management System

  

Company URL:   https://datasemantics.co 


JD:

.Net

.Net Core

Logic App

SQL


 

 

Regards,

Deepu Vijayan | Talent Acquisition



Read more
Hyderabad
2 - 5 yrs
₹5L - ₹15L / yr
skill iconRuby on Rails (ROR)
skill iconRuby
RSpec
skill iconMongoDB

Requirements and Qualifications :
- BS/MS degree in Computer Science, Engineering or a related subject
- 3-5 years of experience with Ruby and the Rails framework
- 3-5 years of experience with Git and Github
- 3-5 years of experience with SQL backends, preferably MongoDB, PostGre SQL
- Familiarity with testing tools such as Rspec
- Knowledge of Docker and docker-based deployment

- Critical thinker and problem-solving skills
- Team player
- Good time-management skills

Read more
Persistent Systems
at Persistent Systems
1 video
1 recruiter
Agency job
via Milestone Hr Consultancy by Jyoti Sharma
Bengaluru (Bangalore), Chennai
4 - 9 yrs
₹5L - ₹25L / yr
skill iconJava
skill iconJavascript
skill iconReact.js
skill iconAngular (2+)
skill iconAngularJS (1.x)
+6 more
Hi Greetings,
Looking  for Integration Engineer
Skill Required- Java, Spring Boot, Microservices, CI/CD 
Read more
Houzeo
at Houzeo
2 recruiters
Nehal Gada
Posted by Nehal Gada
Navi Mumbai, Mumbai
3 - 8 yrs
₹3L - ₹6L / yr
User Experience (UX) Design
User Research
skill iconAdobe XD
Web design

About Houzeo:
Houzeo is an online platform that lets homeowners sell their property by circumventing any traditional intermediaries. The platform enables users to create property listings & upload them to various portals, connect with
local real estate professionals, use the provided dashboard to obtain a property valuation, compare the value with other properties, avail market analysis reports, fill federal/state disclosures electronically, connect with
attorneys/escrow companies, and more. The company earns revenue by

offering various monthly packages.

Houzeo is based in Manhattan, New York with offices in Charlotte, North Carolina (US), and Mumbai, India. Our founder is a finance, real estate, and technology veteran with an ivy-league MBA. We were showcased at the TechCrunch Disrupt Startup Battlefield in New York City. The startup is already profitable and experiencing double-digit month-over-month growth. As we are building our brand, we are growing tremendously and launching new products to enhance customer experience and highlight partner services.

We're scaling rapidly and this in turn has created an opportunity for us to expand our services to cover the mobile
platforms.
Website: https://www.houzeo.com
Headquarters: Manhattan, New York
Location: Thane, Mumbai.
Designation: Senior UI/UX Developer
Preferred Candidate: Has experience both as a UI/UX Designer and Developer

Job Overview
We are looking for a skilled UI/UX Developer to join our IT team. As part of the UI/UX developer role. You will be optimizing software and applications to function smoothly across different devices and screen sizes. Besides, you will be coordinating with the UI Designer, Web Designer, and Backend Developers to improvise
website visuals and functionality. You should be able to develop mock tests and prototypes to determine software/website functionality. As a UI developer, you should have a strong knowledge of HTML, CSS, and
JavaScript.
If you have excellent developer skills that can offer a seamless user experience then do write to us.
Responsibilities
1. Using programming languages like HTML and JavaScript to create responsive web pages
2. Working closely with Designers and Backend Developers to ascertain client needs
3. Optimizing websites, programs, and applications for better speed and functionality
4. Creating aesthetically appealing websites along with a friendly user interface design
5. Following established code practices when undertaking user interface development
6. Designing features and applications for mobile and other screen sizes
7. Coordinating with Developers to rectify any issues
8. Developing functional documentation and guidelines for other team members
9. Conceptualizing website designs and placements
10. Determining project timelines
11. Using analytical tools to determine website performance including website speed, load time, etc.
12. Following UI design guidelines and best practices
13. Ensuring all designs and specifications are rendered properly
Requirements
1. Bachelor’s degree in Information Technology, Computer Science or a related field
2. 5+ years of experience as a UI/UX Developer or Web Developer
3. Complete knowledge of programming languages like HTML 5, CSS 3, C++, Sass, and JavaScript
4. Knowledge of website aseptic practices and UI/UX designs
5. Full-stack experience in developing applications and software
6. Strong analytical skills
7. Ability to work in a team and under pressure
8. Excellent multitasking and organizational skills
9. Up-to-date with the latest UI technologies and practices
10. Understanding of design programs like Adobe Photoshop, Figma and Illustrator
11. An eye for detail and excellent problem-solving skills

Read more
Play Games24x7
at Play Games24x7
2 recruiters
Agency job
via zyoin by Deepana Shahabadi
Remote, Bengaluru (Bangalore)
4 - 8 yrs
₹15L - ₹30L / yr
skill iconPython
DBA
skill iconMongoDB
MySQL
Cassandra
+1 more
Games24x7 was one of the first entrants in the gaming industry in 2006, when India started showing the first signs of promise for online gaming. We turned profitable by 2010 in just four years and grew 200x in the next decade. We are a technology powered analytics and data science company that happens to love games!
In 2018-19, the mobile games market in India generated over $600 million in revenues. With close to 450 people in its Mumbai and Bangalore offices, Games24x7 is India’s largest mobile games business today and is very well positioned to become the 800-pound gorilla of what will be a $2 billion market by 2022. While Games24x7 continues to invest aggressively in its India centric mobile games, it is also diversifying its business by investing in international gaming and other tech opportunities.

Summary of Role
Position/Role Description :
The candidate will be part of a team managing databases (MySQL, MongoDB, Cassandra) and will be involved in designing, configuring and maintaining databases.
Job Responsibilities:
• Complete involvement in the database requirement starting from the design phase for every project.
• Deploying required database assets on production (DDL, DML)
• Good understanding of MySQL Replication (Master-slave, Master-Master, GTID-based)
• Understanding of MySQL partitioning.
• A better understanding of MySQL logs and Configuration.
• Ways to schedule backup and restoration.
• Good understanding of MySQL versions and their features.
• Good understanding of InnoDB-Engine.
• Exploring ways to optimize the current environment and also lay a good platform for new projects.
• Able to understand and resolve any database related production outages.

Job Requirements:
• BE/B.Tech from a reputed institute
• Experience in python scripting.
• Experience in shell scripting.
• General understanding of system hardware.
• Experience in MySQL is a must.
• Experience in MongoDB, Cassandra, Graph db will be preferred.
• Experience with Pecona MySQL tools.
• 6 - 8 years of experience.

Job Location: Bengaluru
Read more
IATOCS LLC
Remote only
2 - 12 yrs
₹3L - ₹12L / yr
Asset management
Digital asset management
digital asset
Business Analysis
MDM
+2 more
  • Collaborate with both internal and external stakeholders to develop digital asset management strategy, integrating the DAL into all relevant business processes
  • Master the organization’s digital asset management platform, managing user access, and providing support and training to help ensure accessibility and ease-of-use for both internal and external stakeholders
  • Maximize discovery of digital assets by enhancing digital assets with metadata that follows established guidelines and is consistent with business objectives.
  • Support lifecycle of image assets after creation, including ingesting, archiving and expiration within DAL and PIM System.
  • Responsible for how internal/external stakeholders and qualified external collaborators can access, use, and interact with the company’s digital assets.
  • Contribute to the development and implementation of workflows for DAL while documenting best practices and monitor implementation.
  • Generate asset reports and conduct audits to maintain and ensure accurate digital asset procedures and policies in both PIM and DAL
  • Excellent interpersonal, communication, and team-facilitation skills Strong analytical and problem-solving skills.
  • Previous experience with product attribute data, Previous experience with data mapping and data validation.
  • Previous experience with digital asset management, Knowledge or and ability to perform data gathering, analysis and process flow design
  • Knowledge of SAP a plus, Basic project management skills a plus
  • Immediate to advanced skills in Excel required ,Experience with both agile and waterfall project software development methodologies.
  • Strong experience in user testing and project management.
  • DAM/DAL with major platforms (Widen) a plus.
  • Must be detail oriented with strong analytical skills.
  • Must be able to work in a fast-paced environment with the ability to manage multiple priorities and multiple deadlines.

 

Read more
ApnaTime
at ApnaTime
4 recruiters
Preethi HV
Posted by Preethi HV
Remote only
4 - 8 yrs
₹15L - ₹40L / yr
skill iconPython
skill iconRuby
skill iconGo Programming (Golang)
skill iconJava
skill iconRuby on Rails (ROR)
+2 more

Company Introduction (apna)


We are building a novel platform to create better economic opportunities for the blue/grey
workforce around the world. We are a very product focused and customer obsessed company. Delivering high quality products at lightning speed is our USP. If you are looking for challenging work and rapid merit based growth in your career, look no further and welcome aboard.

Checkout our product on Google Play store apna - Job Search App | Job Groups

Job Description

We are looking for a Senior Back-End Engineer responsible looking for engineering ownership of one/many products at apna. Your primary focus will be development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end (Android + WebApp). A basic understanding of front-end technologies is therefore necessary as well.

Responsibilities
● Take ownership of end-to-end product development
● Be champion of Test Driven Development methodology
● Building reusable code and libraries for future use
● Optimization of the application for maximum speed and scalability
● Implementation of security and data protection
● Technical Documentation around the owned product

Skills And Qualifications
● Expert level in OOPS concepts and REST API development
● Proficiency in one or more of the following languages: Python, Java, Ruby, Go
● Knowledge around ElasticSearch, Celery, Redis is must
● Integration of multiple data sources and databases into one system
● Implementing automated testing platforms and unit tests
● Proficient understanding of code versioning tools, such as Git
● Knowledge of GCP would be a plus

Perks
● Have autonomy to work from home. Only one rule: Get things Done!
● We promote and celebrate team members contributing at a variety of professional
conferences and events. Be a speaker, contribute to open sourcepublish academic
work, publish an online blog showing your expertise. we are here to encourage you!
● You join us in your current area of expertise and let us know about your personal
professional goals. Looking to start your company? Further studies at the best institutes?
Want to change career track? We make sure you reach there!
● Generous pool of ESOPs

Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos