Data Engineer - Python, Apache, Spark at Spica Systems · Kolkata · 3 - 5 years · ₹7L - ₹12L / yr · Raised funding · Posted 3 May 2022

Requirements:
- Overall 3 to 5 years of experience in designing and implementing complex large scale Software.
- Good in Python is must.
- Experience in Apache Spark, Scala, Java and Delta Lake
- Experience in designing and implementing templated ETL/ELT data pipelines
- Expert level experience in Data Pipeline Orchestrationusing Apache Airflow for large scale production deployment
- Experience in visualizing data from various tasks in the data pipeline using Apache Zeppelin/Plotly or any other visualization library.
- Log management and log monitoring using ELK/Grafana
- Git Hub Integration
Technology Stack: Apache Spark, Apache Airflow, Python, AWS, EC2, S3, Kubernetes, ELK, Grafana , Apache Arrow, Java

About Spica Systems
About
Connect with the team
Similar jobs (10)
Proactively identify and pursue new business opportunities by pitching influencer marketing solutions to brands across multiple industries. Build, manage, and expand long-term relationships with key decision-makers, including brand managers and marketing stakeholders at established companies. Understand brand objectives, campaign goals, and target audiences to recommend the most relevant and high-performing creators from our network. Execute structured outbound sales efforts, including cold emails, calls, and LinkedIn outreach. Develop and present customized influencer marketing proposals aligned with the client’s vision, supported by creative strategy and data-driven insights. Collaborate with internal teams to ensure successful campaign planning and execution
Job Title: Lead Java Developer
Experience Required: 7+ Years
Location: Mumbai
About the Role
We are seeking a highly skilled Senior Backend Developer with deep expertise in building scalable, high-performance applications. The ideal candidate will have strong hands-on experience with Java, Spring Boot, Microservices, and distributed systems. You will play a key role in designing and optimizing APIs, architecting robust systems, and collaborating with cross-functional teams to deliver innovative solutions.
Key Responsibilities
- Design, develop, and maintain scalable backend systems using Java, Spring Boot, and Microservices architecture.
- Build and optimize APIs for large-scale applications ensuring high performance and reliability.
- Apply clean coding principles, SOLID design patterns, and clean architecture to deliver maintainable and robust code.
- Work with distributed systems technologies (Kafka, ELK, in-memory databases, Cassandra, or similar).
- Write efficient SQL queries and integrate with relational and NoSQL databases.
- Collaborate with product managers, architects, and other developers to define and align on technical decisions.
- Identify and solve complex problems with innovative and scalable solutions.
- Drive best practices in coding standards, system design, and performance optimization.
- Communicate complex technical concepts clearly across teams and stakeholders.
Skills & Qualifications
- 7+ years of experience as a Backend Developer.
- Strong expertise in Java, Spring Boot, Microservices, SQL.
- Significant experience in API design and optimization for enterprise-scale applications.
- Proficiency in distributed systems & related technologies (Kafka, ELK, in-memory DBs, Cassandra, etc.).
- Strong understanding of object-oriented engineering principles (SOLID, clean architecture).
- Excellent problem-solving and analytical skills with the ability to simplify complex concepts.
- Strong communication and collaboration skills, with the ability to influence and align teams.
Job Title: .NET Full Stack Developer
Experience: 3 to 6 Years
Work Mode: Hybrid (2-3 days from office)
Location: Gurgaon
Joiners: Immediate joiners or candidates who have completed their notice period preferred
Key Responsibilities
- Design, develop, and maintain web applications using .NET (C#) on the backend and Angular/React on the frontend.
- Develop RESTful APIs and integrate them with front-end components.
- Collaborate with UI/UX designers, backend developers, and product managers to deliver high-quality features.
- Write clean, maintainable, and efficient code following best practices.
- Participate in code reviews and contribute to continuous improvement of development processes.
- Troubleshoot and debug issues across the application stack.
- Work with DevOps teams to support CI/CD pipelines and deployment.
- Ensure application scalability, performance, and security.
- Contribute to documentation, unit testing, and version control.
Required Skills
- Strong proficiency in C# and .NET Core/.NET Framework.
- Experience with JavaScript and modern front-end frameworks like Angular or React (preference for Angular).
- Exposure to cloud platforms – Azure (preferred), AWS, or GCP.
- Good understanding of HTML5, CSS3, and TypeScript.
- Experience in RESTful API development.
- Familiarity with Entity Framework and SQL-based databases like SQL Server.
- Understanding of version control systems like Git.
- Basic knowledge of CI/CD practices and tools like Azure DevOps or Jenkins.
1. Respond to customer queries in a timely and accurate way, via phone, email, or escalate unresolved issues to the appropriate internal teams
2. Take ownership of customer issues and ensure prompt resolution
3. Maintain customer records by updating all relevant information in the database
4. Meet personal/team qualitative and quantitative targets
5. Providing complete information about the product to the customer.
6. Solving all product or service-related issues of the customers.
7. Keeping a proper record of the customers.
8. Maintaining and updating the information of the customers regularly.
9 . Maintaining a pleasant working environment for your team.
10 . Creating policies and procedures.
11. Conducting quality assurance surveys with customers and providing feedback to the staff.
Responsibilities
- Proficient knowledge of a NodeJS and Express.
- Understanding differences between multiple delivery platforms (such as mobile vs, desktop), and optimizing output to match the specific platform
- Good understanding of server-side templating languages (such as Jade, EJS, Jinja, etc. depending on your technology stack)
- Good understanding of server-side CSS preprocessors (such as Stylus, Less, Sass etc. depending on your technology stack)
- Creating database schemas that represent and support business processes
- Data migration, transformation, and scripting
- User authentication and authorization between multiple systems, servers, and environments
- Integration of multiple data sources and databases into one system
- Understanding differences between multiple delivery platforms, such as mobile vs. desktop, and optimizing output to match the specific platform
- Creating database schemas that represent and support business processes
- Implementing automated testing platforms and unit tests
- Management of hosting environment, including database administration and scaling an application to support load changes
- Understanding of fundamental design principles behind a scalable application
- Good understanding of advanced JavaScript libraries and frameworks such as AngularJS.
Technical Skills
- VueJS
- Express
- Socket.IO
- NuxtJS
- MongoDB (3.x)
- Mongoose
(only IT services)
. Responsible for acquiring new clients and figuring out emerging opportunities in the global market.
. Generating Business for Web, Mobile application, & Software designing & development Services, Virtual Reality Projects, etc,
. Experience in writing Proposals, Bidding for .NET Projects, Web and Mobile Development, follow-ups, competition analysis, and discussion with offshore clients.
. Project price estimation, quote, proposal creation, talking with Client, and closure.
. Experience with interacting with clients in US/ UK/ Canada/ Australia/UAE Countries.
. Building competitive portfolios on portals to generate leads.
. Getting business through different channels(Upwork, Freelancer, People per hour, Craiglist, Odesk, Elance, Guru, Email Marketing Etc.)
. Quality project selection and bidding.
. Lead generation through Linkedin, databases and other social networks would be added value.
. Collecting and analyzing the project's business requirements and transferring the same knowledge to the development team.
. Providing suggestions to the development team during the development stage of the product to meet the client's business needs.
. Able to Communicate between the Client and the Technical team.
. Assist in enforcement of project deadlines and schedules.
. Quickly understands the business issues and data challenges of the client's organizations and industry.
. Documentation and analyze the required information and data.
. Client communication & bridging the gap.
Skills Required:
1. Good networking skills
2. Leadership skills
3. Strong communication and IT fluency
4. Creativity and problem-solving skills
5. In-depth knowledge of the industry and its current events
6. Ability to handle pressure and meet the deadline
7. Skill in prioritizing and triaging obligations
8. Attention to detail
9. Excellent time management and organization
10. Specialization - Business Analyst, Market Research, Marketing Strategy
Exceed your potential… come join us!
Edubridge is hiring for Java full stack trainer| | Remote/WFH |Full time.
Job description :
- 2+ years of experience in imparting technical training/ mentoring
- Must have very strong concepts of Software development process
- Must have hands-on and training experience on Core Java 8, Advanced Java, Java Script, HTML, CSS, Web Architecture, Database Storage, HTTP & Rest, C# & C++, any backend language like Python
- Should have knowledge on Spring, Spring Boot and Hibernate
- Should have knowledge on Angular, Bootstrap
- Should be good in Operating systems GNU/Linux, Network fundamentals,
- Must have knowledge on MS office (Excel/ Word/ PowerPoint)
- Must have knowledge on NetBeans/ Eclipse or any other IDE.
- Should have knowledge on any of the Unit Testing tools.
- Self-Motivated and passionate about technology
- Excellent analytical and logical skills and team player
- Must have exceptional Communication Skills/ Presentation Skills
- Good Aptitude skills is preferred
Responsibilities:
- Ability to quickly learn any new technology and impart the same to other employees
- Ability to resolve all technical queries of students
- Conduct training sessions and drive the placement driven quality in the training
- Must be able to work independently without the supervision of a senior person
- Participate in reviews/ meetings
Qualification:
- UG: Any Graduate in IT/Computer Science, B.Tech/B.E. – IT/ Computers
- PG: MCA/MS/MSC – Computer Science
- Any Graduate/ Post graduate, provided they are certified in similar courses
ABOUT EDUBRIDGE
EduBridge is an Equal Opportunity employer and we believe in building a meritorious culture where everyone is recognized for their skills and contribution.
Launched in 2009 EduBridge Learning is a workforce development and skilling organization with 50+ training academies in 18 States pan India. The organization has been providing skilled manpower to corporates for over 10 years and is a leader in its space. We have trained over a lakh semi urban & economically underprivileged youth on relevant life skills and industry-specific skills and provided placements in over 500 companies. Our latest product E-ON is committed to complementing our training delivery with an Online training platform, enabling the students to learn anywhere and anytime.
To know more about EduBridge please visit: http://www.edubridgeindia.com/">http://www.edubridgeindia.com/
You can also visit us on https://www.facebook.com/Edubridgelearning/">Facebook , https://www.linkedin.com/company/edubridgelearning/">LinkedIn for our latest initiatives and products
strong working experience with developing restful services should have experience working on application frameworks such as java ,spring, spring boot, aop
strong working experience with developing restful services
Community Management-
- Create a friendly environment to facilitate high member satisfaction
- Be thoughtful while interacting with members.
- Plan and launch community initiatives to create connections between members of different organizations. This might include targeted member introductions, recommending possible mentor matches, running networking events and managing communications within the space and through digital vehicles.
- Seek out information about the business and personal objectives of tenant organizations and their individual members.
- Foster a sense of inclusivity where fresh ideas are welcome
- Be knowledgeable about COWERKZ's membership contracts and guidelines.Explain these policies to members, as necessary.
- Oversee new member onboarding and member moves out of the space
Events Planning and Execution-
- Build a quarterly calendar of coworking events that engages all stakeholders:
- Current members: Educational (e.g., lunch and learns) and appreciation events (e.g., happy hours and themed parties)
- Future members: Lead generation and sales-related events
- Local community: Identify outside organizers and encourage them to use our event space. Depending on the exact nature, these events should also be used to build COWERKZ's CRM and digital community.
- Manage to the allotted budget
- Present our community professionally
- With your team, oversee the event itself, from catering to a smooth event check-in process to cleanup
Business Development-
- With the owners, be responsible for setting and achieving sales objectives, occupancy rates and pricing
- Conduct tours for prospective members
- Contact the local press and community leaders to generate interest in COWERKZ.
- Maintain a positive relationship with key vendors and our landlord
Facilities and Space Management-
- Manage all centre operations to the satisfaction of members
- Maximize up-time and availability of key facilities assets like the Wifi network, kitchen, printers/copiers
- Keep members aware of facilities issues that may impact them
- Utilize a variety of coworking software applications manage the space and membership
- Make recommendations to the owners about new features or perks that will entice members
- Submit maintenance tickets for repairs to the facility and key equipment
- Ensure cleaning is conducted to spec
Data accuracy-
- Ensuring member data is updated and is current in the cowork platform
- Ensuring lead data is updated in the CRM platform
- Ensuring Community Data is being updated in the events database
Experience and Requirements
- 2 years experience with increasing responsibility in either a sales or customer service role
- Experience in co -curricular activities a plus.
- Demonstrated project management skills
- Technically capable. Able to understand and work with the variety of hardware and software applications that our space depends on.
- Experience with written content generation in a business environment and basic graphic design skills are a plus
- Interest in working independently with only occasional interactions with the owners
- Fluent in English. Ability to speak additional language is a plus.
- A high level ethics, empathy and dependability
Qualifications
- Bachelor's degree or equivalent









