About Wandertrails Services Pvt Ltd
Similar jobs
Job Title Big Data Developer
Job Description
Bachelor's degree in Engineering or Computer Science or equivalent OR Master's in Computer Applications or equivalent.
Solid Experience of software development experience and leading teams of engineers and scrum teams.
4+ years of hands-on experience of working with Map-Reduce, Hive, Spark (core, SQL and PySpark).
Solid Datawarehousing concepts.
Knowledge of Financial reporting ecosystem will be a plus.
4+ years of experience within Data Engineering/ Data Warehousing using Big Data technologies will be an addon.
Expert on Distributed ecosystem.
Hands-on experience with programming using Core Java or Python/Scala
Expert on Hadoop and Spark Architecture and its working principle
Hands-on experience on writing and understanding complex SQL(Hive/PySpark-dataframes), optimizing joins while processing huge amount of data.
Experience in UNIX shell scripting.
Roles & Responsibilities
Ability to design and develop optimized Data pipelines for batch and real time data processing
Should have experience in analysis, design, development, testing, and implementation of system applications
Demonstrated ability to develop and document technical and functional specifications and analyze software and system processing flows.
Excellent technical and analytical aptitude
Good communication skills.
Excellent Project management skills.
Results driven Approach.
Mandatory SkillsBig Data, PySpark, Hive
Primary Skills & Criteria [Mandatory]
- Technology Business Analyst
- Experience with Finance IT, EPM IT, ETL Processes
- Minimum Work Experience: 12+ years
Other Requirements [Good to have]
- Exposure to tools like Jira, Confluence, etc.
- Exposure to development and production support processes
- Exposure to EPM tools [e.g., HFM, FMDEE, etc.]
- Candidate should be able to lead and track technical developments/tasks independently and present status to management
- Candidate should be self-motivated and self-sufficient to work independently without much supervision
- Strong verbal and written communication skills
Role Duties/Activities
The Technology “Agile Business Analyst” or “Business Analyst” is responsible for ensuring the team works within an Agile delivery method and that their backlog of requirements and analysis feed into Technology Projects and Programmes successfully.
This role will carry out some or all of the following activities:
- Assures delivery through the entire life cycle of the project of user requirements through to live
- Managing the capture, analysis, and documentation of business process (including IT processes)
- Designing solutions or change interventions
- Oversee change management activities which can include diverse tasks such as timeline planning to
- stakeholder engagement
- Manage or collaborate in change interventions such as training and communication
- Tracking and documenting progress and managing status reporting
- Managing implementation of solutions
- Risk identification, risk reporting and devising interventions to mitigating risks
- Budget management and forecasting
- Management of external service providers
- Support Technology teams to manage delivery proactively, balancing scope, schedule, resourcing, dependencies, communications, etc.
- Work with the Technology team and Product Owner to drive improvements in productivity through backlog management, maturity in the use of Agile methodologies (e.g. Scrum, Kanban, Lean), and corresponding management of dependencies
- Oversee the monitoring and reporting of progress, issues, dependencies, risks to the stakeholders
- Ensure adherence to standard controls and drives teams to achieve compliance and framework,
- capability management, Security controls and technology architecture designs
Responsibilities:
- Analyse and evaluate both existing and potential social media activities and strategies
- Conduct, gather and analyse market research to determine social media opportunity and competitiveness
- Identify, interpret, and capitalize on social media trends
- Plan, manage, coordinate and execute all social media programs and initiative
- Work closely with other organizations to ensure tight integration of all social media programs and initiatives
- Develop unique value propositions, business partnerships, and social media programs that are target towards key customer segments
- Achieve targeted results and ensure timely and effective execution of social media tactics and programs
- Develop benchmark criteria to measure the effectiveness of social media programs and implement improvements as required
- Participate and initiate online conversation across a variety of channels
- Educate and prepare key messaging and presentation material for senior management and other marketing organizations
- Collaborate with internal stakeholders to provide support to their initiative
- Measure the success of social media activities and report the result to management
- Use social listening tools to monitor online conversations
- Create maintain executive social media editorial calendars and posting schedules
- Design, create and manage promotions and social ad campaigns, and integrate with the company's overall marketing campaign plan and channels.
-
Job requirements:
- A track record of performance excellence meeting targets and objectives
- Strong analytical, planning, forecasting, and research skills
- Excellent communication and writing skills
- The ability to manage multiple priorities and demanding time frames
- Knowledge and understanding of technology search for new trends and the latest in social media innovation
- Must Excel at online research, possess excellent writing skills, and have the ability to create editorial content at a moment’s notice
- Experience in advertising public relations and online marketing is a plus
- Proficient with Microsoft office product
- Proficient with social listening tools such as tweet deck, Google alerts, etc
- Ability to integrate social media into broader marketing campaigns
- Experience in Facebook Ads, LinkedIn Ads, and other social media ads is a plus
- Ability to identify threats and opportunities within the user-generated content space and make quick decisions
- Experience in integrating content into multiple social distribution channels
- Proven track record of listening and engaging with online community acting on their behalf
Education and Experience Requirements:
- Preferable Mass Communication in business administration or a related field
- 1 -2 years of sales experience
We are looking for an outstanding Big Data Engineer with experience setting up and maintaining Data Warehouse and Data Lakes for an Organization. This role would closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Roles and Responsibilities:
- Develop and maintain scalable data pipelines and build out new integrations and processes required for optimal extraction, transformation, and loading of data from a wide variety of data sources using 'Big Data' technologies.
- Develop programs in Scala and Python as part of data cleaning and processing.
- Assemble large, complex data sets that meet functional / non-functional business requirements and fostering data-driven decision making across the organization.
- Responsible to design and develop distributed, high volume, high velocity multi-threaded event processing systems.
- Implement processes and systems to validate data, monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
- Perform root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Provide high operational excellence guaranteeing high availability and platform stability.
- Closely collaborate with the Data Science team and assist the team build and deploy machine learning and deep learning models on big data analytics platforms.
Skills:
- Experience with Big Data pipeline, Big Data analytics, Data warehousing.
- Experience with SQL/No-SQL, schema design and dimensional data modeling.
- Strong understanding of Hadoop Architecture, HDFS ecosystem and eexperience with Big Data technology stack such as HBase, Hadoop, Hive, MapReduce.
- Experience in designing systems that process structured as well as unstructured data at large scale.
- Experience in AWS/Spark/Java/Scala/Python development.
- Should have Strong skills in PySpark (Python & SPARK). Ability to create, manage and manipulate Spark Dataframes. Expertise in Spark query tuning and performance optimization.
- Experience in developing efficient software code/frameworks for multiple use cases leveraging Python and big data technologies.
- Prior exposure to streaming data sources such as Kafka.
- Should have knowledge on Shell Scripting and Python scripting.
- High proficiency in database skills (e.g., Complex SQL), for data preparation, cleaning, and data wrangling/munging, with the ability to write advanced queries and create stored procedures.
- Experience with NoSQL databases such as Cassandra / MongoDB.
- Solid experience in all phases of Software Development Lifecycle - plan, design, develop, test, release, maintain and support, decommission.
- Experience with DevOps tools (GitHub, Travis CI, and JIRA) and methodologies (Lean, Agile, Scrum, Test Driven Development).
- Experience building and deploying applications on on-premise and cloud-based infrastructure.
- Having a good understanding of machine learning landscape and concepts.
Qualifications and Experience:
Engineering and post graduate candidates, preferably in Computer Science, from premier institutions with proven work experience as a Big Data Engineer or a similar role for 3-5 years.
Certifications:
Good to have at least one of the Certifications listed here:
AZ 900 - Azure Fundamentals
DP 200, DP 201, DP 203, AZ 204 - Data Engineering
AZ 400 - Devops Certification
- Proven hands-on Software Development experience
- Proven working experience in Java development
- Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)
- Experience in the Spring boot , hibernate Framework
Efficiently and effectively fill open positions by: Placing ads, screening resumes,
conducting interviews, scheduling applicants, and hiring final candidates.
Post positions to appropriate Internet sources, and ensure accurate and error-
free advertising.
Excellent customer service skills, communicates proactively and consistently with
teams.
Submits daily / weekly recruiting reports to internal leadership team.
Supports coordination of interviews for qualified applicants with client department
hiring management.
Administers new hire workflow, including checking references as requested,
submitting for background checks, ensuring background check has been
completed, scheduling drug screens, collecting paperwork, and extending offers
to selected candidates.
Maintains job order and candidate application files.
Schedules pre-placement testing where applicable.
Performs other related duties as assigned or requested.
What makes you a great candidate
- Experience with connecting or consuming API's (REST, SOAP, GRAPHQL)
- IPAAS/ETL experience is a huge plus.
- An understanding of basic scripting. PHP is a plus
- Data modelling/data architecture/data warehousing experience
- Familiarity with CRM platforms
- Self-motivated, proactive team player Strong communication and interpersonal skills
- Bachelor’s Degree or higher in a related technical field
Your responsibilities
- Engage with Customer and Partner technical staff and developers to identify requirements
- Design their technical architecture and data model
- Assist & implement integrations, on-boarding, and deployment
- Verify the integrated solution with configuration audits and provide long-term support
- Onboard new customers for faster time-to-value
- Gather customer requirements, systems, data model, and custom metrics
- Recommend best-practice approaches
- Assist in other testing / QA activities in support of getting customers live
- Respond to Customer Support Service Requests and Escalations
- Maintain high customer satisfaction
- Partner with cross-functional teams
- Work with Product Management, Support, and Engineering to translate Customer business needs and product feedback into new solutions
- Assist the Sales teams in setting up prospective customers for success in on-boarding
- Act as a thought leader and Blendr advocate in webinars, blog postings, and speaking events
- Exhibit diplomacy, tact, and poise when working through customer issues and escalations