Pacifica Graduate Institute is an accredited graduate school located in Santa Barbara, CA offering masters and doctoral degree programs framed in the traditions in Depth Psychology. Half of the faculty is actively involved with research, while the other half are scholar practitioners with a focus on their practices.
One of the challenges at Pacifica is that because their faculty are in the social sciences, and a rather esoteric branch, their research does not fit the citation count method of assessing impact. Specifically, they produce a lot of monographs and presentations. They want to be able to showcase this research, but the usual tools would not work.
Alain Dussert, Director of Library Services, said he saw a presentation on altmetrics about a year ago and it opened his mind to the possibilities of tracking influence beyond citation counts. In his words, “Our faculty are esoteric and old school, but they do show up in monographs and YouTube presentations.” When EBSCO acquired PlumTM Analytics, Dussert saw it as a validation of altmetrics and he seriously started looking at PlumXTM.
Pacifica became a PlumX customer in June, and since then they have loaded most of their faculty researchers and their research output, including monographs and YouTube videos. Dussert states that they have found how well PlumX deals with monographs, “WorldCat holdings are very useful.” First, they now have an easy way to see what libraries hold the monographs their faculty have created. Second, using the OCLC Control Number is a good way to track Pacifica research as not everything they’ve created has an ISBN.
Below is a monograph published in 2011.
As you can see from the PlumX usage statistics, 45 libraries hold this book. If we investigate further, we can see also that there are 11 readers on Goodreads, and reviews and ratings on Amazon and Goodreads.
Dussert sees many uses of PlumX at Pacifica. For starters, he thinks his admissions department will use it to “show off rock stars to prospective students.” Another use is as a centralized location to show accrediting agencies the research that has been done.
Dussert is looking forward to using PlumX more and more because it is so flexible and can be used for many purposes.
We have hosted periodic webinars titled “Plum Analytics and Our Approach to Altmetrics.” Many people have attended and we have had good feedback. Since these webinars have been held during times that are inconvenient to many, we are offering it live two more times in early September for the rest of the world.
Title: Plum Analytics and Our Approach to Altmetrics
Who: Mike Buschman, Plum Analytics, Co-Founder & Chief Product Officer
Date: Thursday, September 4, 2014
Time: 11:00 am, Australia Eastern Standard Time (Sydney, GMT+10:00)
Plum AnalyticsTM considers books an important research output or artifact, as demonstrated by our use of OCLC WorldCat metrics (see this blog for more information). We are now expanding our support of books with metrics from Goodreads.
Goodreads’ mission is to help people find and share books they love. With over 30 million members and 900 million books, Goodreads is the world’s largest site for readers and book recommendations. While Goodreads is a force in popular literature, the site also includes many important academic books, especially in humanities and social sciences.
Using the Goodreads API, PlumXTM now includes:
Below is a psychology book authored by a researcher with a PlumX profile.
Here are the Captures and Mentions for this book. You can see that this book has 17 Goodreads readers and one review.
You can click through to see the information at Goodreads.
Additionally, you can see the Goodreads rating (along with Amazon) right in PlumX.
We are excited to keep expanding PlumX with more metrics and more features. Stay tuned to this blog for more information.
Sanford-Burnham Medical Research Institute is a non-profit medical research institute located in La Jolla California and Florida. Sanford-Burnham is one of the seven National Cancer Institute (NCI)-designated basic research cancer centers in the United States. Sanford-Burnham has over 80 full-time faculty all with their own labs and over 900 scientific staff members working on research. They have received over 170 NIH grants representing over $90 million in the last five years.
Jennifer Vigil, Librarian at Sanford-Burnham, said that at the same time a lot of people were asking questions about their grants, journal citation reports, and metrics about their publications, they had the opportunity to trial PlumXTM. According to Vigil, they seized the trial opportunity because they were going to have access to metrics that were not available through any of their traditional tools.
Since they implemented, Vigil reports having visibility into new ways people are interacting with their research, for example, Facebook Likes & Shares and capturing articles in Mendeley. Below is an article from Sanford-Burnhman’s PlumX that illustrates what Vigil is talking about. This article was just published in 2014, so has not had time to gather citations. Yet, with PlumX you can tell that there is already usage and social media attention, and 48 people capturing this article in Mendeley. These captures can be good indicators of future citations.
Sanford-Burnham is organized around fourteen programs so they set up their PlumX dashboard by program to see the metrics for each program. Some example programs are:
Within each program they have themes so it can be narrowed down even further. For example within the Bioinformatics and Structural Biology program there are two themes, Structural Bioinformatics/Systems Biology and System Biology of Microbes & Microbiome. They can see the metrics for the program, for both of these themes, as well as metrics for the researchers and their research output in the program.
Below is the first page of the Sanford-Burnham PlumX dashboard where you can see a list of programs. This page also displays the research output and their metrics for the entire organization.
"It’s been fun" says Vigil about implementing PlumX and dealing with the structure and the faculty and seeing metrics emerge as more and more PMIDs were put into the system.
Taylor & Francis recently published their annual Open Access Survey. This is a survey they conducted of the authors they published during 2012.
What interested us about the survey were the responses concerning usage statistics.
Sixty percent of the respondents said that usage and download statistics will become important for assessing the value of research over the next ten years. Only 12% said that they would not be important. While citations still rank (81%) as the most important way for assessing the value of research in the coming decade, it is clear that more and more authors are seeing the importance of the new ways people interact with and use research.
At PlumTM Analytics, we see this survey as validation of our view of altmetrics, or rather ALLmetrics since the definition of altmetrics does not include usage, nor do most altmetric providers.
When we developed PlumXTM there was growing attention to the role social media was playing in scholarly communications. We knew that Twitter, Facebook and others were becoming a big part of research promotion, and subsequently important to measure. But, we also knew that there were lots of other metrics that are important in understanding the impact of research. We set out to gather as many of those metrics as we could and categorize them in a meaningful way for clearer understanding. We wrote about this categorization in a previous blog.
One of those categories is Usage.
PlumX categorizes a lot of activity in Usage including, Downloads, Views, Holdings and Video Plays.
Recently, we added usage statistics from EBSCO Databases, eBooks and EBSCO Discovery Service. You can read about this in more detail on our blog. By including this amount of usage across publishers, PlumX gives you a good proxy of the usage of articles and other research output.
Plum Analytics also makes it easy to show usage to your authors in your open access repositories.
If you embed the PlumTM Print widget into your repository you can show your authors usage and other altmetric information. You can read more about the Plum Print in this blog post.
We can also include the usage statistics of the repository itself. That is exactly what some of our customers are doing. See this blog for more details and see this example below.
We are excited that we can help authors of Open Access articles assess the value of their research.
One of the things we looked forward to when considering our EBSCO acquisition was more collaboration between our companies. So, it is exciting to announce that PlumXTM now includes usage metrics for articles and books from EBSCO Databases, EBSCO Discovery Service and EBSCO eBooks.
This marks the first time the wealth of information about the actual usage per article or book, such as abstract views, downloads, etc. can be measured across publishers. While we recognize that this does not represent all usage, it is a good proxy, and it gives you more usable information about articles and books.
One of our customers, Alain Dussert, Director of Library Services at Pacifica Graduate Institute, liked what he saw and commented,
Wow, bringing in EBSCO usage stats is an impressive development. The benefits of being able to see EBSCO ‘hits’ by author is really going to bring tremendous amounts of relevant scholarly data to PlumX. That is a big, and I mean, big, development. I don’t think anyone has ever done that before, to be honest.
Below is an image of a PlumX Article page. You can also view it live here,
You can see that it includes EBSCO usage. Prior to adding this usage, this article indicated seven Mendeley readers. The Mendeley captures are an important statistic and indicate good interaction with this article. Now, with the addition of the EBSCO usage, you get a fuller picture of the level of interest in this article.
Here is a closer view of the article level metrics:
Below is a list of the specific usage metrics we get from EBSCO Databases, EBSCO Discovery Service and EBSCO eBooks.
Here is an article page with metrics in all five categories, Usage, Captures, Mentions, Social Media and Citations that includes EBSCO Usage. See it live here.
You can read more in our recent press release here.
It is our goal to give as complete a picture of research output - from articles and books to videos and web pages, and everything in between - as we can. We are very interested in working with publishers and others directly to include more usage data. Please email us if you are interested in discussing this further.
Autism Speaks is set to use PlumXTM to track the research impact of the research they fund.
Autism Speaks is the world’s leading autism science and advocacy organization, dedicated to funding research into the causes, prevention, treatments and a cure for autism; increasing awareness of autism spectrum disorders; and advocating for the needs of individuals with autism and their families.
We are thrilled that this organization, which has spent over $200 million to fund autism research since they were founded, is using PlumX to track and evaluate this research.
Autism Speaks will use PlumX to track the metrics about the research outputs that their funding has helped create. Specifically, using PlumX, Autism Speaks will gather and analyze metrics at many levels and views. These include:
By doing this, they will have powerful and actionable information about the research they fund. For the first time Autism Speaks will be able to tell the stories of impact behind what they are doing and have a better idea about the ROI of their funding. Furthermore, by opening this data, donors will see the impact of the funds they’ve donated, researchers can get credit for what they’ve done, and mentees will gain visibility.
We are really excited about working with Autism Speaks to implement their research grants with new metrics that can benefit the whole research community by enhancing the way we look at research impact and scholarly communication.
To read the press release go here.
The key to quickly navigating complex data sets is to turn them into elegant, simple visualizations that do the hard work for you. We think our new PlumTM Print does exactly that. With one glance, it’s easy way to see the relative impact of each of the five categories of metrics - usage, captures, mentions, social media, citations - that we track (see this post for more information on these categories). A simple mouseover over the Plum Print quickly shows the metrics behind the visualization.
We have always included data visualizations as part of PlumXTM, in fact, one of our first data visualizations was the sunburst used to visualize a researcher’s output. We also wrote about this in a previous post.
The Plum Print is a natural evolution of that effort, designed to work at the artifact level, and carries forward the work we’ve done categorizing metrics. You can now see at a glance the impact of a given article, presentation, or any other research artifact.
In developing the Plum Print we learned that boiling down all of the metric information to a single number was like boiling down a home to just its purchase price. A $500,000 urban Victorian built in 1880 is different from the $500,000 brand new suburban home on a cul-de-sac. Sure, both are worth the same, but that number does not even come close to telling the stories of both homes.
The Plum Print visually changes based upon the metrics in each category. Each circle of the Plum Print represents one of the five categories of metrics – Usage, Captures, Mentions, Social Media or Citations. By the size of the circle, you quickly visualize the relative number of metrics, and indeed, whether there are any metrics at all in a given category.
In addition to creating the Plum Print, we updated our artifact page to make it easier to see impact. Here is an example of the new artifact page.
You still have the valuable and necessary information about the artifact, e.g. title, authors, journal, etc. Now, the metrics are easier to see and the impact is easier to grasp.
To read our press release go here.
As a self-professed data junkie, I always thoroughly enjoy the yearly Internet Trends presentation from Mary Meeker from Kleiner Perkins Caufield & Byers.
One slide that jumped out talks about the very small percentage of data that is “tagged” and the even smaller amount of data that is “analyzed” in the Digital Universe.
(See all the slides here.)
These percentages hold true with what we have seen at Plum Analytics when looking at the data exhaust surrounding scholarly research output. Although we cannot yet gather metrics for ALL output, we are increasingly able to quantify the engagement around an ever-growing set.
Working with our partners and customers, we continue to make progress on tagging and building analytics and dashboards for curated subsets of the world’s scholarly data.
Drilling into the stat of why only 1% of the data in the digital universe is analyzed, it’s illustrative to think about just how fast this universe of data is expanding. Below is a real time infographic that shows this expansion really well.
Note that the above image is just a sample of the data at PennyStocks.la, it is worth clicking through to see the live infographic.
At Plum Analytics, we’re excited to think about the opportunities of harvesting the firehose of data surrounding scholarly output, and utilizing it to tell the great stories of the impact that researchers are having.
We’re excited to announce that PlumX is Shibboleth enabled. Institutions and large enterprises can now authenticate PlumX in the way they are used to for subscription services. In addition the Shibboleth-enabled authorization also provides the identification process necessary to safeguard researchers’ profiles. By using this authentication method, PlumX knows who is using PlumX and allows for researchers to update their own profiles but not others. Likewise, other authorized users, such as a liaison librarian, can update specific researcher profiles, while preventing others from doing so.
From the beginning, we wanted to build products that met the needs of institutions. Supporting Shiobboleth in PlumX is one of the ways we are fulfilling this goal.
Click here to see the press release.