Job Description:
We are looking for a Big Data Engineer who have worked across the entire ETL stack. Someone who has ingested data in a batch and live stream format, transformed large volumes of daily and built Data-warehouse to store the transformed data and has integrated different visualization dashboards and applications with the data stores. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them.
Responsibilities:
- Develop, test, and implement data solutions based on functional / non-functional business requirements.
- You would be required to code in Scala and PySpark daily on Cloud as well as on-prem infrastructure
- Build Data Models to store the data in a most optimized manner
- Identify, design, and implement process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Implementing the ETL process and optimal data pipeline architecture
- Monitoring performance and advising any necessary infrastructure changes.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
- Proactively identify potential production issues and recommend and implement solutions
- Must be able to write quality code and build secure, highly available systems.
- Create design documents that describe the functionality, capacity, architecture, and process.
- Review peer-codes and pipelines before deploying to Production for optimization issues and code standards
Skill Sets:
- Good understanding of optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and ‘big data’ technologies.
- Proficient understanding of distributed computing principles
- Experience in working with batch processing/ real-time systems using various open-source technologies like NoSQL, Spark, Pig, Hive, Apache Airflow.
- Implemented complex projects dealing with the considerable data size (PB).
- Optimization techniques (performance, scalability, monitoring, etc.)
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB, etc.,
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Creation of DAGs for data engineering
- Expert at Python /Scala programming, especially for data engineering/ ETL purposes
About Ganit Business Solutions
About
Ganit Inc. is in the business of enhancing the Decision Making Power (DMP) of businesses by offering solutions that lie at the crossroads of discovery-based artificial intelligence, hypothesis-based analytics, and the Internet of Things (IoT).
The company's offerings consist of a functioning product suite and a bespoke service offering as its solutions. The goal is to integrate these solutions into the core of their client's decision-making processes as seamlessly as possible. Customers in the FMCG/CPG, Retail, Logistics, Hospitality, Media, Insurance, and Banking sectors are served by Ganit's offices in both India and the United States. The company views data as a strategic resource that may assist other businesses in achieving growth in both their top and bottom lines of business. We build and implement AI and ML solutions that are purpose-built for certain sectors to increase decision velocity and decrease decision risk.
Connect with the team
Company social profiles
Similar jobs
Job Title: React Native Developer with Web3 Experience
Location: Gurgaon (Work From Office - 6 Days)
Job Description:
We are seeking a skilled React Native Developer with experience in Web3 technologies to join our team in Gurgaon. The ideal candidate will have a passion for mobile app development and a strong understanding of blockchain and decentralized applications.
Key Responsibilities:
- Develop and maintain mobile applications using React Native.
- Integrate Web3 technologies and blockchain features into applications.
- Collaborate with cross-functional teams to design and implement new features.
- Troubleshoot and optimize app performance for seamless user experiences.
Requirements:
- 2+ years of experience in React Native development.
- Hands-on experience with Web3.js, blockchain APIs, or smart contract integration.
- Strong understanding of mobile app development lifecycle.
- Excellent problem-solving skills and attention to detail.
Benefits:
- Competitive salary and opportunities for growth.
- Collaborative work environment with cutting-edge technology.
Job Title: Senior Python Developer
Location: Mumbai
Company: Wissen Technology
Job Type: Full-time
About Us:
Wissen Technology is a dynamic and innovative technology solutions company that specializes in [mention specific industry or technology focus, e.g., fintech, AI, etc.]. Our team is at the forefront of delivering cutting-edge solutions to our clients, and we're looking for a highly skilled and motivated Senior Python Developer to join us in shaping the future of technology.
Responsibilities:
- Software Development:
- Lead the design, development, testing, and deployment of high-quality Python-based applications.
- Collaborate with cross-functional teams to deliver robust and scalable software solutions.
- Technical Leadership:
- Mentor and guide a team of developers, fostering a culture of innovation and continuous improvement.
- Stay abreast of emerging technologies and industry trends, providing technical expertise to support strategic decision-making.
- System Architecture:
- Design and implement scalable and maintainable software architectures aligned with project requirements.
- Collaborate with architects and stakeholders to ensure the integrity of overall system design.
- Code Review and Quality Assurance:
- Conduct regular code reviews to ensure code quality, adherence to coding standards, and knowledge sharing among team members.
- Implement and enforce best practices for code testing, deployment, and documentation.
- Problem Solving:
- Analyze and resolve complex technical issues, providing innovative and efficient solutions.
- Proactively identify opportunities for system and process improvements.
Requirements:
- Bachelor's or Master's degree in Computer Science or related field.
7 years of hands-on experience as a Python Developer.
- Strong proficiency in Python and relevant frameworks (e.g., Django, Flask).
- Experience with database systems (e.g., SQL, NoSQL).
- Solid understanding of front-end technologies (e.g., HTML, CSS, JavaScript).
- Demonstrated leadership experience with the ability to lead and inspire a development team.
- Excellent communication and collaboration skills.
- Proven track record of delivering high-quality software solutions within deadlines.
-
Should be atleast having 10 + years of exp with scaled startups / high growth startups
-
Preferably have done 0-1 or 1-10 (build things from scratch in HR & have scaled it )
Roles & ResponsibiltiesRoles & responsibilities :-
You will work closely with the senior most leadership and will be responsible to build and drive HR strategy across functions to foster organisation growth.
-
Create a conducive culture that enables the team to grow the organisation & themselves.
-
Set up policies and processes and create an employer brand in the market.
-
Leadership role with fast growing early age startup
-
Work closely with senior stakeholders in a high impact rol
Experience and Qualifications-
Overall 12+ years experience in HR post MBA from a reputed B-School.
-
Having worked in an online/ digital start up ecosystem is a must.
-
Experience working as a HR Business Partner, HR Operations, HR Generalist, TA etc.
-
Strong business acumen with experience managing a team and diverse stakeholders.
What’s an offerAn excellent opportunity to work with a well funded early age start up in their fast growing set up in a leadership role working closely with a strong leadership team of expert professionals. -
Looking for a Senior Java technologist at Bangalore.
This position is with a fast growing Ecommerce Startup.
Kindly Refer To The Below Pointers :
- Hands on experience in developing Java with OOAD, Datastructures, Mullithreading
Technical Architect responsible for SDLC, designs, developer mentoring, code reviews, hands on implementations.
- Strong proficiency in Java, design patterns.
Required Technologies:
o Excellent understanding of Ruby, Ruby on Rails, CSS3
o Able to communicate well with others on technologies bases
o Working knowledge with Rspec is good to have.
o Have previous experience building features in production applications.
o Good Knowledge of SQL
Good To Have
o Basics of GIT and GIT LAB
o PostgreSQL
Able to understand frontend JS frameworks
Roles and Responsibilities
Design and implement email marketing campaigns for lead generation and branding.
Proofread emails for clarity, grammar, and spelling.
Identify target audience and grow our email list.
Ensure mobile-friendly email templates.
Analyze campaign performance and suggest improvements.
Report on sales revenue generated from email marketing efforts.
Conceptualizing marketing campaigns that speak directly to the pain points of existing and prospective clientele.
Collaborating with graphic designers to improve the appearance layout of outputs.
Maintaining a database of customers who have opted to receive our correspondence.
Should know email marketing tools and email marketing automation.
Roles and Responsibilities-
-
Planning concepts by studying relevant information and materials.
-
Illustrating concepts by designing examples of art arrangement, size, type size, and style and submitting them for approval.
-
Preparing finished art by operating necessary equipment and software.
-
Coordinating with web designers, marketing, printers, and colleagues as necessary.
-
Contributing to team efforts by accomplishing tasks as needed.
-
Creating a wide range of graphics and layouts for product illustrations, company logos, and websites with software such as Photoshop.
-
Reviewing final layouts and suggesting improvements when necessary
Requirements-
* Proficiency with required desktop publishing tools, including Photoshop and Illustrator Adobe XD.
* A strong eye for visual composition.* Able to give and receive constructive criticism.
* Effective time management skills and the ability to meet deadlines.Knowledge of Video Editing preferable (Adobe Premiere Pro / After Effect)
*Experience with computer-aided design.
Daily monitoring of Quantum's processes to ensure file transmissions to and from the system
- Ensure that any Quantum production issues with an emphasis on the modules ( Cash Management, Bank Reconciliation, Foreign Exchange, I/C loans, Money Market, Investments, etc.) are resolved on time
- Actively working with Quantum and internal IT teams to resolve issues with bank files and data transmissions between Quantum and other systems including retrieval of market rates