Defence Science and Technology Laboratory
Dstl releases free Baleen 3 data processing update
Baleen 3 is a tool co-developed by Dstl for building data processing pipelines and offers users the ability to search, process and collate data.
The Defence Science and Technology Laboratory (Dstl) has released a new free version of its popular data processing tool.
Baleen 3 is a tool for building data processing pipelines using the open source Annot8 framework and succeeds Baleen 2, one of the first open source projects by Dstl, the science inside UK defence and security. It offers users the ability to search, process and collate data, and is suitable for personal and commercial applications. It has been used across government, and by industry and academia, and also internationally as well as in the UK.
The tool enables the creation of a bespoke chain of “processors” to extract information from unstructured data (e.g. text documents, images). For example, Baleen 3 could process a folder with thousands of Word Documents and PDFs in it to extract all e-mail addresses and phone numbers in those documents and store them in a database.
As well as text, Baleen 3 can also find and extract images within those documents, perform OCR to find text within those images, translate that text into English, and then run machine learning models to find mentions of People within those images.
Baleen 3 supports components developed within the Annot8 framework, and as a result it is easy to extend and develop further to cover new use cases and provide additional functionality. There are already a large number of components available for use within the Annot8 framework, including some previously developed by Dstl.
Following the release of Baleen 3, support for the existing Baleen 2 project will be withdrawn. Dstl is encouraging all users to move to using Baleen 3 where possible. Baleen 3 is built on top of newer technologies, and will be easier to maintain and deploy as a result of the upgrade. It also extends Baleen 2’s focus on text to support other forms of unstructured data, such as images.
Baleen 3 was co-developed by Dstl staff on the Augmenting the Analyst project (Information Systems programme), and Committed Software.
Latest News from
Defence Science and Technology Laboratory
Market exploration: future policing20/10/2020 11:10:00
DASA wants to understand the current market capability and development requirements for future policing initiatives.
Dstl’s new counter-terrorism facility opened by The Queen16/10/2020 12:10:00
The Queen, accompanied by the Duke of Cambridge, officially opened Dstl's new state-of-the-art Energetics Analysis Centre and met specialist scientific staff.
First space mission for Dstl29/09/2020 09:05:00
Dstl will conduct the the first tasking of a commercial satellite by a UK Government-owned and operated ground station for nearly 20 years
Science enables soldiers and aircrew to partner with smart machines on Salisbury Plain24/09/2020 16:10:00
Scientists from the Defence Science and Technology Laboratory (Dstl) have been working with soldiers, aircrew and industry partners on Salisbury Plain in Wiltshire in a unique experiment to see how humans and a new generation of smart machines can partner to change the way that military operations are conducted.
DASA launches search for telexistence technology24/09/2020 13:10:00
Funding available to develop capabilities to operate in hazardous environments without physically being present.
Rare Fellowship for Dstl Scientist23/09/2020 13:43:00
In recognition of his outstanding contribution to the profession, Dstl’s Dr Bryn Hughes has been elected as a Fellow of the Royal Academy of Engineering.
Science Minister at Vitae Connections Week 202016/09/2020 10:20:00
In a recorded message, Amanda Solloway recently (14 September 2020) spoke about the promoting a culture of wellbeing for researchers and improving the way we evaluate research.
Dstl SME Searchlight Announces New Webinar Programme15/09/2020 14:15:00
Air systems and policing webinars scheduled for October
Metropolitan Police Commissioner Cressida Dick Sees Dstl’s Police Innovation28/08/2020 11:05:00
The Commissioner of the Metropolitan Police, Dame Cressida Dick, has visited the Defence Science and Technology Laboratory to see the latest innovations being trialled in support of the police and judicial system.