Thank you.

Your uploaded files are waiting for moderation.

<< Go Back

Big Data – A New Testing Challenge

Reading Time: 2 minutes

Download a copy of these slides here.

Over the last few years big data has grown from a marketing buzzword into a significant technology sector dominating both technology headlines and corporate IT strategies. Whilst there are many varied technologies, both new and old, that can lay claim to being part of this big data sector, there are common elements that characterise them. As more applications become part of the ‘Internet of things’ gathering increasing volumes of information, the testing of Big Data technologies is set to move from a niche market to become more of a mainstream testing challenge. When testing a big data system we have to dispense with some of the commonly seen categorisations that are applied to many software projects. Scale and performance are elevated from being non-functional requirements to being the cornerstone of many of our requirements and targets. Even ‘small’ testing installations can run to many machines, and the execution times of builds and automation suites extend well beyond what would be considered acceptable in other sectors. In this webinar Adam Knight will present on the challenges that face a testing team working on a Big Data product. He’ll discuss how integrating with other Big Data technologies, such as Hadoop, presents challenges in itself due to the rapid rate of change of the software in this emergent market. Adam will explain the benefits and restrictions that are encountered when working with Big Data systems in a modern agile development approach. He will go on to present some of the approaches, both in automation and in their management of testing activities, that his team has successfully adopted in tackling the big data testing challenge.

Key Takeaways:

        1. Explore the challenges of integrating BIG Data technologies on the rapid changing software market
        2. Adopt a modern agile approach to working with BIG Data systems
        3. Learn automation & test management approaches to tackling BIG Data testing challenges

Editor's Image

Adam Knight

Adam has been testing data storage and analysis software for over 10 years, with 7 of those spent working in an agile team.

Adam is an enthusiastic exponent of exploratory testing approaches backed by discerning use of automation. He is a great believer in creating multi-skilled teams based on rich and unique individual skill sets. At his current employer, RainStor, Adam has overseen the testing and technical support of a large scale “Big Data” storage system from its initial release through to successful adoption in some of the largest telecommunication and financial services companies in the world. He writes at

Leave a Reply

Skip to toolbar