|

Is This Big Data Which I See Before Me?

Hello, I’m Dorothea Salo from the School of Library and Information Studies at the University of Wisconsin at Madison, and the first thing I’m going to do is apologize for the talk title in the day’s agenda, which is a horrific misquotation of Shakespeare’s Macbeth. Totally my fault, not Eric’s or OCLC’s, sorry about that—it’s correct on the slide!

So, big data.

A well-known characterization of “big data” describes it as having volume, velocity, and variety. Big volumes of data is probably the first thing to spring to mind when somebody says “big data”—I don’t think I need to explain it—but size is not everything! Velocity matters too: how fast do these data pile up? How fast do they need to be cleaned up and used? How fast does interaction with the data need to be? How easy is it to get data where they’re going in the form they need to be in?

That gets to the third vee, variety. From a computational perspective—and computers are notoriously persnickety and not-smart about this—how clean are the data in the first place? how much effort does it take to clean them, and how much of that effort can be automated? Note that high variety is not a good thing! Ideal data for analysis is clean and above all consistent. It’s easy to understand, and simple to use a computer to mess around with. In the real world, though, big data tends to mean more variety than is wanted. So a bit of hope here for libraries as we struggle with variety in our data: it’s not just us and we’re not alone!

So keep these vees in mind as I go on talking. None of them is more important than any other; they all factor in to making the best use of big data.

Where they most breed and haunt…

So where’s big data? It’s everywhere. It’s in science—oops, the Large Hadron Collider twitched, that’s another petabyte. It’s on the web, of course, from Google to Facebook to Amazon.

Why, I can buy me twenty at any market…

What need we fear who knows it, when none can call our power to account?

And even beyond the online giants, big data has hit business, where the hype cycle is highest, and where “big data” seems to mean something like “anything we can collect about our customers or users and their behavior to correlate with other companies’ data in flagrant violation of any notion of privacy.” And I think it’s important to watch how that debate evolves, as academe and its libraries keep getting told “behave like a business!” and businesses keep behaving so horrendously.

“Why, I can buy me twenty at any market,” incidentally, is said by Lady Macbeth, and it’s about husband acquisition. That Lady Macbeth, business genius for our time!

But in these cases
We still have judgment here; that we but teach
Bloody instructions, which, being taught, return
To plague the inventor:

Big data is in education, who knew? It’s in the form of “learning analytics.” We in academic libraries should be watching this, as should folk who have served on IRBs, because it’s troubling from a student-privacy perspective and I don’t know who has more authority in academe to speak truth to power about privacy than academic librarians.

So, of course libraries have data, and we use data in decisionmaking, in asserting our value, in collection-development and service decisions, and so on. All I need to do is say “LibQual,” right? The question I was asked to address today, though, is whether libraries have, or will have, “Big Data.”

Your face, my thane, is as a book where men
May read strange matters.

Kind gentlemen, your pains
Are register’d where every day I turn
The leaf to read them.

And I have several answers to that question.

  • YES, libraries have big data. Of course we do.
  • YES, libraries have or could have big data, BUT its collection or use is somehow problematic.
  • NO, sometimes what libraries have there isn’t big data. It might be big, it might be important, but it’s not actually data, and that is often problematic.
  • Some library data could be big data, but NOT YET it’s not. And finally…
  • Big Data, SIGH. We could have big data and it’d be super-cool if we did, but something completely unnecessary is in the way.

Big data? Yes.

Some of you are looking at me right now all like “what a ridiculous question! Of course libraries have big data! Where have you been for the last twenty years?!” And you know, if that’s you, you are quite right. National libraries and some major research libraries have been in the big-volume data game for some time because of digitization, and more recently, conscious collection of large volumes of born-digital materials. Here’s what Leslie Johnston claimed last year the Library of Congress is hanging onto digitally: five million newspaper pages, some hundreds of thousands of e-journal articles, five billion web-archive files, scads of digital audio and video, and what by now is probably close to if not more than a hundred billion tweets.

Interestingly, I’ve seen news stories that hint that the Library of Congress’s Twitter database is running into a serious velocity problem! They have all the tweets, just not the computational power to let researchers or anybody else do anything with them. It’s too big a dataset to be downloadable, so the combination of high volume and a hoped-for high velocity is pretty deadly.

We’re probably all familiar with Hathi Trust’s home page by now; in fact, a lot of the institutions represented in this room are Hathi Trust members. It’s worth remembering that Hathi Trust came about in order to solve a classic big data volume problem: where the heck to put all those page scans and OCRed texts from the Google Books project! As Hathi grows and changes, we see its people tackling more problems that would sound really familiar to a big-data analyst in business or a so-called data scientist: what can we find out from this gigantic pile of bits? How do we best clean up the OCR so that linguistic and literary analysis is reliable, and how do we deal with language variation over time?

I have to tell you, as a historical-linguist-in-a-past-life and a sometime computer programmer, a lot of the analyses I see Ph.Ds proudly trotting out these days are pretty weak. I don’t just mean “the digital humanities,” either, though there’s plenty of eye-rolly work there—that “culturomics” stuff coming out of Google’s comp-sci people has some pretty obviously overbroad conclusions stemming from a failure to consider the limitations of their evidence base appropriately. There’s a lesson in that, though: with big data, we’re all learning by doing. We’ll get better at it; just give us time, and room to monkey around.

Threescore and ten I can remember well:
Within the volume of which time I have seen
Hours dreadful and things strange…

Yes, libraries collectively have big data and have had it for a long time! This is not new at all. What’s changing is that individual libraries are starting to run into high-volume and high-variety data problems. In academic libraries, for example, faculty are starting to look to us to help with research-data management. Some digital libraries are seriously getting into targeted web archiving, too.

And here’s where I go all finger-shaky at us: right now, in May 2013, most of us are not investing nearly enough in computing infrastructure and development to be able to keep up well. We heard this morning from Sarah Pritchard that data management and curation is a thing in research institutions; I’m here to tell you that the opportunity for libraries to stake a claim to research-data management and archiving in particular is a time-limited one. If academic libraries don’t prove we can help—and that means a lot more than putting together a committee or hiring one person—researchers should and will go elsewhere.

So we can have Big Data… but only if we decide we want it badly enough.

Yes… but

If you weren’t watching, you missed this one: Harvard Library for a very brief time piloted a service called Library Hose that tweeted the titles of books that had been checked out of the library, shortly after that checkout. Eyes were rolled, fusses were fussed, and the Library Hose was shut down, because honestly, it’s kind of a bad idea. But that’s only a funny example of extremely serious questions about ethical uses of the data that libraries could and sometimes do collect about patrons, individually and in aggregate, on-purpose and inadvertently: search data, patron-computer-use data, patron-behavior data.

We discussed the differentiation of libraries from other services earlier in the Q&A, but in my mind at least, it’s an easy question. We want to differentiate ourselves from Google, our search competitor? We want to differentiate ourselves from Facebook, our social-activity competitor? We want to differentiate ourselves from Amazon, our content-purveying competitor? Easy. We do not sell out our patrons through their data.

Ever.

For any reason.

Even if they invite us to. No matter how tempting it is, how many nifty things we could build, or how hard our patrons push us to do things that we know could turn around and bite them, in this age of increased surveillance from government and business and black-hat hackers everywhere. These are surely “political problems” rather than technical ones, but you can’t just wish political problems away. I’m avoiding the obvious cheap shot here out of respect for the dead, but I’m sure all of you can fill it in for me. In lieu of that, I’ll just say that America Online and Netflix both learned really quickly that “sanitizing” data doesn’t, and “deidentified” data isn’t.

We don’t sell out our patrons. We just don’t. That’s our first requirement whenever we talk about using or even keeping certain kinds of patron data, or patron-traceable data. The only way to keep data safe is often to destroy it or refuse to keep it in the first place. Fact of the computing life.

Big data? No. This isn’t even data.

This is a subtle point, but one that governments are particularly struggling with as open data becomes a thing for them: it’s possible to turn data into something that looks like data but isn’t, which often defeats the purpose of collecting or sharing the data in the first place. Does this happen in libraries? You bet. And often, it happens with exactly the kind of data we’ve been discussing today.

…thereby shall we shadow
The numbers of our host and make discovery
Err in report of us.

This Traverse Area District Library web page, a sort of library-activity snapshot infographic, is brilliant and I love it. When it made the rounds of my online librarian friends, there was a chorus of “I want my library to do this!” But it’s not data. There’s data underneath it somewhere, but as presented, this is not data. It could be—and if we could collect this information from libraries all over the place, it could even be big data—but it’s not. The problem is that third vee, variety. If I wanted to compute on these numbers, I’d have to grab the HTML and laboriously write code to extract the numbers from it, and as soon as Traverse Area District Library changes their content-management system or does a redesign, my code breaks. Multiply this by all the libraries in all the cities and towns in all the states everywhere, and you see the problem.

So, acknowledging that qualitative data is often-though-not-always an exception to this rule, take this rule away with you: if it’s not computable, it’s not data, big or otherwise. Libraries have treated the computability of the data we create and collect as a low-priority consideration for far too long.

… up, up, and see
The great doom’s image!

Making an infographic or a pie chart or a data HTML table takes pieces of the data—usually not even everything—and reduces them to something that tells a story, because graphs and charts and tables almost always tell stories much better than the actual data do. So a graph or a table or a chart or an infographic is data trapped in amber. It’s very beautiful, and human beings appreciate that beauty, but you can’t get those little particles of data back out, much less do anything useful with them if you did! They’re just not computable any more. You’ve doomed your data!

Any data you’re putting out there in PDFs, incidentally? It’s not data any more! Stop that! We in libraries should be setting the example here! And we should lean on our vendors about this, too. There’s just no point in them providing data that we can’t use for our purposes.

The sacred storehouse of his predecessors,
And guardian of their bones.

Which brings me to the skeleton in the closet (speaking of bones): MARC. If I had a nickel for every cataloger who’s asked me what the problem is with MARC and AACR2 and ISBD, I would never need to work a day in my life again. Here’s the problem in a nutshell, and it’s not news, because Kim [Armstrong] alluded to it earlier with respect to harmonizing serials holdings in the CIC. The records we put into our library catalogs are marginally computable at best. If you don’t believe me, ask any programmer anywhere who’s worked with MARC records. And you heard Kim talk about Google Books and library metadata—look, Google has the smartest engineers anywhere; if they can’t compute on our data, it’s not computable. That uncomputability is costing us untold amounts of money in systems and cleanup programmers, not to mention mindshare on the larger information web that libraries are only a part of. We have got to do better.

Another aspect of the MARC problem gets back to the third vee, variety. Local practice, rule interpretations and other changes over time that don’t get retroactively fixed in old records, places where AACR2 just throws up its hands and says “as long as it’s human-readable, do what you want,”—all this increases the variety in our catalog records, which decreases their computability and reuse value. Whatever happens with RDA and BIBFRAME and similar efforts, if we end up with yet another sloppy tower of Babel, it’s not solving the problems we have.

Cataloging for your users—computers, their programmers, and their users are your users.

Strange things I have in head, that will to hand;
Which must be acted ere they may be scann’d.

Digital librarians, among whom I include myself—come on, we know we’re not off the hook here. I ran institutional repositories for six years, and I got an entire published article out of one authority-control mishap where one author had eight different name variants in the IR. Our data isn’t clean and consistent. It isn’t computable, and it can’t be aggregated usefully or consistently. Let’s not pretend!

What we can do, though, is watch the big data pioneers and the techniques they use to cut through the chaos. Natural-language processing. Fuzzy matching. If you haven’t played with Open Refine, which used to be Google Refine, you completely need to grab some random data from your catalog or digital library or wherever and do that—it’s actually really fun! If only so that you see what the possibilities are.

Big Data? Not yet.

Libraries also have data that doesn’t look all that big—or all that powerful—when you only have it from a single library, but if you add together that same data from a whole bunch of libraries, suddenly you have something super-interesting.

Ay, in the catalogue ye go for men;
As hounds and greyhounds, mongrels, spaniels, curs,
Shoughs, water-rugs and demi-wolves, are clept
All by the name of dogs: the valued file
Distinguishes the swift, the slow, the subtle,
The housekeeper, the hunter, every one
According to the gift which bounteous nature
Hath in him closed; whereby he does receive
Particular addition.

The term of art for this, of course, is “aggregation,” and it happens all over the place already; it’s nothing new. Any data, any data at all, can be aggregated… in theory. In practice, a successful aggregation depends a lot on keeping a lid on that third big-data vee, variety. It may also depend on velocity: keeping things current, fixing errors quickly, and similar speed-dependent concerns.

We shall not spend a large expense of time
Before we reckon with your several loves…

All the cataloguers in the room know this already, of course, because of WorldCat. I’m not a cataloguer and definitely no expert, but I do know that OCLC does its level best to enforce certain kinds of consistency in contributed MARC records, above and beyond what MARC and AACR2 and RDA insist on, because if they don’t, the search engine doesn’t work! And, you know, we all know they don’t do a perfect job of it… but to some extent that’s on us, because of the MARC closet skeletons I mentioned earlier.

I see thee compass’d with thy kingdom’s pearl…

Any Michigan folks here? Here’s a blast from the past for you: OAIster, which now belongs to our good hosts at OCLC. See, we’ve tried large-scale aggregation with highly heterogeneous metadata—far more variable than the MARC coming from skilled cataloguers—before. With OAIster, it didn’t work out so well. Variety in our data bit us yet again, as did some really pretty unwise and evitable structural flaws in the harvesting protocol OAI-PMH, such as total lack of error reporting and no flag for metadata-only records so that searches could exclude them.

What have we learned from the wonderful, bizarre, epic mess that is OAIster? Let’s see.

O proper stuff! This is the very painting of your fear…

We have another chance to try aggregation, in the guise of the Digital Public Library of America. It’s very early days yet, but I did want to call out one thing that I think DPLA is doing right: cutting the Gordian knot of intellectual-property rights in metadata. Long story short, some metadata is too factual to qualify for copyright protection in the US; other metadata such as abstracts clearly does qualify. But DPLA isn’t playing that game. They say very clearly: if you want to play with us, you do not play intellectual-property games with your metadata. You start up with that, we kick you out. They’re gambling, of course, that they become enough of a name to conjure with that they can make this stick. As I said, it’s early days, but I’m not betting against them—and I appreciate this approach very, very much.

Here’s what I want to know, though. Can DPLA get past the metadata-quality issues that made a mess out of the National Science Digital Library, never mind OAIster? They seem to be leaving training and quality control to their Service Hubs. Maybe that will work, but I don’t see any kind of feedback loop being built in here, and it worries me some.

Big data? Sigh. It could be, but…

And that question leads me to what if I were the Porter in Macbeth I’d call something simultaneously grandiloquent and obscene, but since I’m not the Porter in Macbeth, I’ll just call it “the graveyard of missed big-data opportunities.”

The multiplying villanies of nature
Do swarm upon him

There’s so much we should know about books that we don’t, in spite of all the effort we spend cataloging books. A public-librarian friend of mine, Laura Crossett, was simply trying once to make sure they had all the books in any series where any book in the series was circulating well. What happened? The series information stumped her. This is just a silly problem to have. Honestly, I think we have it because our ideas and practices around cataloging are so fragmented and so calcified.

And digital librarians, we only get to gloat about this because we’re often describing unique and standalone materials. Otherwise, we’re just as bad.

We need to build big data together—it’s not just the responsibility of the Library of Congress or the New York Public Library or Harvard or OCLC, it’s everybody’s responsibility. And one of the ways we do it is by eliminating redundant labor, well beyond copy cataloging even, so that we can actually do things like record series information and relationship information to further embiggen and enrich our data. I think the linked-data infrastructures that several national libraries are building can do that… if we let them!

…there cannot be
That vulture in you, to devour so many

Am I the only one who worries about the sixth V of Big Data? “Velociraptor.” When a big commercial aggregator swoops in & devours everything.

—Les Carr (in a tweet)

I can’t really add anything to this combination of Les Carr and Shakespeare. I’m just going to admire this for a second… and no, I don’t know what the fourth and fifth vees are either.

But seriously, Les is right. We saw it with serials and their metadata, we’re seeing it now with e-textbooks, we’re even starting to see it with a few kinds of research data, and I don’t know who will stop it and build a real big-data commons if it’s not academic libraries. So if you need a reason to get involved with open access and open data, this is it: it beats the heck out of the velociraptor alternatives.

And because Deb Blecic mentioned it earlier: Non-disclosure agreements are a velociraptor indicator. I don’t like them, and I don’t think any of us should. Just sayin’.

As two spent swimmers, that do cling together
And choke their art.

And here’s where, as I generally do, I bite the hand that’s feeding me. OCLC, you are clearly of two minds on this big data thing, and I think you’re hurting yourself by it. On the one hand, there’s OCLC Research, which is making amazing big data things like the Virtual International Authority File and working hard—and pretty successfully—to embed them in the larger information world. On the other hand, there’s the dog-in-manger intellectual-property shenanigans OCLC proper keeps trying to pull with the records contributed to WorldCat, which made the national library of Sweden pull out of WorldCat altogether, and is infuriating those of us who are paying attention to where the big data world is going.

Please, OCLC, get your act together. If you’re going to insist on being a velociraptor, please spin off OCLC Research so that you don’t drown it when we drown you—and we will. It will take time, just as the open-access movement is taking time, but we can destroy you and we will. Or take OCLC Research as your model and stop being a velociraptor.

… when worldcat.org do come to DPLAne

It’s not just libraries who want to treat WorldCat as a big juicy Big Data-store, either. On FriendFeed once, a librarian quoted what OCLC actually lets affiliates do with WorldCat data in the context of scholarly research, adding: “I can, barely, stretch this definition to include the work that I’m doing on my research project… but the grad student who wants to use WorldCat data for a bibliographic study of the spread of publishing in New Spain is pretty much out of luck.”

Stop it, OCLC. Just stop it. You are shutting yourself out of big data land, and when you do that, you shut us libraries out too. Hathi Trust is willing to fight in federal court to allow researchers to do research on its corpus, and OCLC comes at researchers with legalese? Stop it. DPLA insists that all contributed metadata be available for any meditated reuse, within reasonable limits of bandwidth, and OCLC gives researchers static? Stop it. Bring worldcat-org to DPLAne, instead.

Think upon what hath chanced, and, at more time,
The interim having weigh’d it, let us speak
Our free hearts each to other.

All right, I’m done lecturing OCLC, and now I’m going to lecture everyone else in this room, because I clearly haven’t made enough enemies, right? To some extent, OCLC is doing what it’s doing because it knows that a lot of academic libraries love to free-ride. We heard about this from Kim today briefly with regard to collective print management—“can the CIC let California do it?”—and, you know, I come out of open access and open source, so I’ve seen it firsthand. Contribute programmer time to an open-source project? Nope. Pay for a membership in an open-source foundation, or participate in a collective digital-preservation system? Forget about it; who has money for that? Put actual acquisitions money toward open access? Bah, we have an institutional repository… under somebody’s desk… in the third sub-basement… somewhere; that’s enough, right?

But at some point, free-riding prevents useful collective action, and I think big data is one of those points. Big data isn’t free. Open data, big or small, isn’t free. It’s really tempting to pretend it is and free-ride anyway, I get that. But free riding is slimy and lazy and unethical and we need to stop doing it. No one library can talk OCLC down off the ledge; heaven knows Sweden tried. But maybe we can talk OCLC down together, as a community. Shouldn’t we try?

Big Data? Now what?

I was asked to talk about what skills and scaffolding we need to make and use big data in our libraries. And I’m sorry, Eric, but I tried and tried to make a slide answering that question and I just couldn’t.

Every one that does so is a traitor, and must be hanged.

The reason I couldn’t is that I know what way too many academic libraries do with lists of skills—they think they can just hire some poor Macduff with a random grab-bag list of skills and call him a “Big Data Coordinator” or some such thing, and then they’ve solved the big data problem and they can go home and have a drink.

I don’t work in libraries any more in part because my own career was badly hurt by that kind of “skills thinking” with respect to scholarly communication and open access. I don’t think thinking about library services in terms of laundry lists of skills works! And I know it hurts people, because I’ve had former students come back to me for advice over it, and I’ve seen it hurt much better librarians than I ever had a hope of being.

Now that my job is preparing people for librarianship, I explicitly warn my students about skills thinking and how it manifests in job descriptions, and I tell them not to apply for those laundry-list, unsupported-single-person-in-a-disregarded-corner jobs. The dice are just too loaded against them. So if you think you’re going to hire a Research Data Coordinator, or a Digital Humanities Librarian, or one bioinformaticist, or one statistician, somebody with serious skills, and you’re going to wind that person up and turn them loose and miracles will happen? Well, I’m with Lady Macduff on this one—hang the traitors!

Instead… well, I hate the word “infrastructure,” because it’s impersonal and overused, so I’m going to suggest we build “scaffolding,” by way of a more holistic, less skills-focused mode of thinking about the opportunities big data might have for us, and what we’ll have to be and do to capitalize on those opportunities. I like “scaffolding” because—look, you can hire a Michaelangelo, but if you don’t put that scaffolding under him, he ain’t painting you no Sistine Chapel. So here are some questions I think are worth asking.

  • Who cares, right now? Who else should? (Note that this means you look at your existing staff as well as your environment, because ignoring your current people and their skills and interests is shortsighted and counterproductive.)
  • What bets should we make, now and future? (There is no such thing as a sure thing. We have to bet. Betting means risk, risk means failure. As they say, fail fast and often.)
  • What can we use, right now? How can we experiment?
  • What do we build? Fix?

And that’s where I’m at on this just now! Hope it helped, and I’m findable on Twitter and the web if you have questions.

Page 33
css.php

Source: https://purplesquirrel.dsalo.info/2013-2/is-this-big-data-which-i-see-before-me/