Sign-In
Cart
Simulating Information Retrieval Test Collections
Paperback
Series: Synthesis Lectures on Information Concepts, Retrieval, and S
Sports GeneralChinese HistoryPhysics
Currently unavailable to order
Please enter your email and a message will be sent to you when this product becomes available on our website.
ISBN13: 9783031011955
Publisher: Springer Nature
Published: Sep 4 2020
Pages: 162
Language: English
Simulated test collections may find application in situations where real datasets cannot easily be accessed due to confidentiality concerns or practical inconvenience. They can potentially support Information Retrieval (IR) experimentation, tuning, validation, performance prediction, and hardware sizing. Naturally, the accuracy and usefulness of results obtained from a simulation depend upon the fidelity and generality of the models which underpin it. The fidelity of emulation of a real corpus is likely to be limited by the requirement that confidential information in the real corpus should not be able to be extracted from the emulated version. We present a range of methods exploring trade-offs between emulation fidelity and degree of preservation of privacy.
We present three different simple types of text generator which work at a micro level: Markov models, neural net models, and substitution ciphers. We also describe macro level methods where we can engineer macro properties of a corpus, giving a range of models for each of the salient properties: document length distribution, word frequency distribution (for independent and non-independent cases), word length and textual representation, and corpus growth.
We present results of emulating existing corpora and for scaling up corpora by two orders of magnitude. We show that simulated collections generated with relatively simple methods are suitable for some purposes and can be generated very quickly. Indeed it may sometimes be feasible to embed a simple lightweight corpus generator into an indexer for the purpose of efficiency studies.
Naturally, a corpus of artificial text cannot support IR experimentation in the absence of a set of compatible queries. We discuss and experiment with published methods for query generation and query log emulation.
We present a proof-of-the-pudding study in which we observe the predictive accuracy of efficiency and effectiveness results obtained on emulated versions of TREC corpora. The study includes three open-source retrieval systems and several TREC datasets. There is a trade-off between confidentiality and prediction accuracy and there are interesting interactions between retrieval systems and datasets. Our tentative conclusion is that there are emulation methods which achieve useful prediction accuracy while providing a level of confidentiality adequate for many applications.
Many of the methods described here have been implemented in the open source project SynthaCorpus, accessible at: https: //bitbucket.org/davidhawking/synthacorpus/
Also in
Sports General
The Formative Years of Relativity: The History and Meaning of Einstein's Princeton Lectures
Renn, Jürgen
Gutfreund, Hanoch
Hardcover
The Science Magpie: Fascinating Facts, Stories, Poems, Diagrams and Jokes Plucked from Science
Flynn, Simon
Paperback
Every Dog Deserves an Adventure: Amazing Stories of Camping with Dogs
Tracosas, L. J.
Camping with Dogs
Hardcover
Big Fan: Two Friends, 82,490 Miles, and the Wild, Wonderful Sports We Love
Posnanski, Joe
Schur, Michael
Hardcover
I Told You So!: Scientists Who Were Ridiculed, Exiled, and Imprisoned for Being Right
Kaplan, Matt
Hardcover
Long Range Shooting Handbook: Complete Beginner's Guide to Precision Rifle Shooting
Cleckner, Ryan M.
Paperback
Pardon My Book: Ten Years of the Best (and Worst) in Sports from Pardon My Take
Commenter, Pft
Big Cat
Hardcover
The Inner Game of Tennis: The Classic Guide to the Mental Side of Peak Performance
Gallwey, W. Timothy
Paperback
The Magical Game: The Spirit and History of Baseball's Superstitions, Rituals, and Curses
Baird, Addy
Hardcover
The Long Game: U.S. Men's Soccer and Its Savage, Four-Decade Journey to the Top, or Thereabouts
Schaerlaeckens, Leander
Hardcover
This Is about Running. This Is Not about Running.: Lessons for Between and Beyond the Start and Finish Line
Bennett, Chris
Hardcover
The Great Shadow: A History of How Sickness Shapes What We Do, Think, Believe, and Buy
Bauer, Susan Wise
Hardcover
A Pox on Fools: The True Believers, Grifters, and Cynics Who Convinced Us to Reject Vaccines
Levenson, Thomas
Hardcover
The Ultimate Survival Medicine Guide: Emergency Preparedness for Any Disaster
Alton, Joseph
Alton, Amy
Paperback
The Diet-Proof Body: 5 Simple Habits to Lose Fat, Keep It Off and Escape Diet Prison for Good
Harrison, Trent
Paperback
The Plunge: Maverick Swimmers, an Unlikely Quest, and the Transformative Power of Cold Water
Ballard, Chris
Hardcover
The Playbook: The Hidden Forces Shaping Winners and Losers in the Modern NFL
Robinson, Joshua
Clegg, Jonathan
Hardcover
The Power of Life: The Invention of Biology and the Revolutionary Science of Jean-Baptiste Lamarck
Riskin, Jessica
Hardcover
Compete: Developing a Mental Playbook for Performance Under Pressure in Sport
Abrahams, Dan
Paperback
Relegated: One American's Pints-And-Pies Journey from the Top to the Bottom of English Football
Smith, Todd
Hardcover
The Elements of Marie Curie: How the Glow of Radium Lit a Path for Women in Science
Sobel, Dava
Paperback
Everything Is Tuberculosis: The History and Persistence of Our Deadliest Infection (Large Print Edition)
Green, John
Paperback
Gun Trader's Guide, Forty-Fifth Edition: A Comprehensive, Fully Illustrated Guide to Modern Collectible Firearms with Market Values
Sadowski, Robert A.
Paperback
The Ultimate Soccer Jersey Collection: Iconic Kits from the World's Greatest Game
Football Shirts, Classic
Hardcover
Pheasant Tail Simplicity: Recipes and Techniques for Successful Fly Fishing
Chouinard, Yvon
Mazzo, Mauro
Mathews, Craig
Paperback
Harvey Penick's Little Red Book: Lessons and Teachings from a Lifetime in Golf
Penick, Harvey
Hardcover
Our Moon: How Earth's Celestial Companion Transformed the Planet, Guided Evolution, and Made Us Who We Are
Boyle, Rebecca
Paperback
Your Health: A Corrective System of Exercising That Revolutionizes the Entire Field of Physical Education
Pilates, Joseph H.
Paperback
Take Me to Your Leader: Perspectives on Your First Alien Encounter (Large Print Edition)
Tyson, Neil DeGrasse
Hardcover
Alchemy: An Illustrated History of Elixirs, Experiments, and the Birth of Modern Science
Ball, Philip
Hardcover
Friday Night Lights (25th Anniversary Edition): A Town, a Team, and a Dream
Bissinger, H. G.
Paperback
The Powerful Primate: How Controlling Energy Enabled Us to Build Civilization
Ennos, Roland
Hardcover
2084 and the AI Revolution, Updated and Expanded Edition: How Artificial Intelligence Informs Our Future
Lennox, John C.
Paperback
Your Guide to the 2026 World Cup: Everything You Need to Know about the Players and Teams
Stay, Shane
Paperback
String Theory: David Foster Wallace on Tennis: A Library of America Special Publication
Wallace, David Foster
Hardcover
The Great Math War: How Three Brilliant Minds Fought for the Foundations of Mathematics
Bardi, Jason Socrates
Hardcover
The Inner Game of Tennis (50th Anniversary Edition): The Classic Guide to Peak Performance
Gallwey, W. Timothy
Hardcover
Coaching with Heart: Taoist Wisdom to Inspire, Empower, and Lead
Lynch, Jerry
Huang, Chungliang Al
Paperback
Knicker Bonkers: The New York Knicks' Wild NBA Championship Run to End a 53-Year Title Drought
New York Post
Paperback
Bioinspired: How Nature Made Us Modern, Drives Today's Technological Innovation, and Inspires a Future Worth Inventing
Stier, Samuel Cord
Hardcover
Science of Cycling: Transform Your Ride, Gain Strength, Revolutionize Your Training
Bailey, David
Paperback
How to Read Nature: Awaken Your Senses to the Outdoors You've Never Noticed
Gooley, Tristan
Paperback
Inside the Owner's Box: Conversations on Power and Leadership in Sports
Rubenstein, David M.
Hardcover
The Formula: How Rogues, Geniuses, and Speed Freaks Reengineered F1 Into the World's Fastest-Growing Sport
Clegg, Jonathan
Robinson, Joshua
Hardcover
Notes on Complexity: A Scientific Theory of Connection, Consciousness, and Being
Theise, Neil
Paperback
Todo Es Tuberculosis. La Historia de la Infección Más Mortal de la Humanidad / Everything Is Tuberculosis
Green, John
Paperback
Interregnum: Inside the Grueling and Glamorous Battle to Become the Next King of Chess
Himelfarb, Jordan
Hardcover
Surviving the Trail: Five Essential Skills to Prepare Every Hiker for Adventure's Most Common Perils
Scanlon, Rob
Paperback
The Pleasure of Finding Things Out: The Best Short Works of Richard P. Feynman
Feynman, Richard P.
Paperback
A Year of Forest School: Outdoor Play and Skill-Building Fun for Every Season
Houghton, Peter
Worroll, Jane
Paperback
Checkmate: Genius, Lies, Ambition, and the Biggest Scandal in Chess (Large Print Edition)
Mezrich, Ben
Paperback
Flashes of Brilliance: The Genius of Early Photography and How It Transformed Art, Science, and History
Burgess, Anika
Hardcover
Training for the New Alpinism: A Manual for the Climber as Athlete
House, Steve
Johnston, Scott
Paperback
The Age of Alchemy: The Secret History of Chemistry from Ancient Magic to Modern Science
Chapman, Kit
Hardcover
Miscalculated Risks: Attacked, Crippled, Paralyzed, Drowning, Unconscious and Freezing in The Wild (Just Not All at Once)
Cooper, Michael
Paperback
Quadrivium: The Four Classical Liberal Arts of Number, Geometry, Music, & Cosmology
Ashton, Anthony
Sutton, Daud
Lundy, Miranda
Hardcover
The Surgeon, the Midwife, the Quack: How to Stay Alive in Renaissance England
Skuse, Alanna
Hardcover
Horse Country: Inside the World of Equestrian Style and Sport, from British Dressage to Western Riding
O'Shea-Evans, Kathryn
Hardcover