NewsTalk: Developing a full stack data-as-a-service on the Nectar ARDC Research Cloud
Marissa Takahashi1, Matthew Bettinson1, Robert Fleet 1Queensland University of Technology, BRISBANE CITY, QLD, Australia
Abstract
This presentation will introduce NewsTalk, a comprehensive data-as-a-service tool designed to empower researchers to investigate Australian public discourse on daily news topics. NewsTalk harvests data from dozens of Australian news platforms and supports extensive data exploration and data download functionality from a modern web app. NewsTalk is a component in the ecosystem of resources being developed by the Australian Digital Observatory, a co-investment platform project with the Australian Research Data Commons, Queensland University of Technology, University of Melbourne, Queensland Cyber Infrastructure Foundation, University of New South Wales, and University of Queensland.
We explore the design and architecture of a modern research platform, incorporating backend infrastructure, modern web frontend, custom web harvesters, API services, and client-side Python modules. Services of this kind are typically costly to develop but we focus on a pattern shaped by modest eResearch resources. We discuss useful tactics such as cutting-edge server-side rendered web frameworks and deploying on Nectar ARDC Research Cloud.
Finally, we touch on the breadth of skills necessary for the future full-stack research software engineer to deploy similar research platforms.
Biography
Dr Mat Bettinson is a Senior Developer/ Data Scientist at the QUT Digital Observatory. He has a background in full-stack research software development using web technologies. He’s currently excited and frightened by the AI revolution and what it means for software engineering and research data.
Robert Fleet is a Data Scientist/Developer at QUT Digital Observatory. Robert’s unique research interest lies in studying MMO game data, specifically to investigate the structure of organized criminal groups. Prior to his current role, he contributed his expertise as a Data Scientist, E-Research Analyst, and Technical Lead on a cutting-edge drone surveillance project.
Marissa Takahashi is the Manager of the QUT Digital Observatory and the Project Manager of the Australian Digital Observatory, a co-investment platform project with the Australian Research Data Commons, Queensland University of Technology, University of Melbourne, Queensland Cyber Infrastructure Foundation, University of New South Wales, and University of Queensland. Marissa Takahashi holds a PhD in Business Information Systems, an MBA from The University of Queensland Business School and MSc in Information Engineering from Kyushu Institute of Technology in Japan. She has worked in the private industry and other research organisations. Her research interest lies at the intersection of business, technology, and innovation.