Contributing Authors

We love the opportunity to meet you and talk about how we approach new ways to assess research impact and scholarly communication. We are taking to the road for the next couple of months to appear at various conferences and meetings. We’d like to meet you. If you are at any of these events, please introduce yourself.

Bibliometrie2014 (Sept. 24 - 26, Regensburg, Germany)

image    This is the 2nd time this International conference has been held. You can hear PlumTM Analytics’ product expert Stephan Buettgen present “Altmetrics in Practice” on 25 September at 11:30.

1:AM Altmetrics Conference (Sept. 25 -26, London, UK)

image     Andrea Michalek, President and Co-Founder, will be on hand to present and moderate sessions. She will also  show our the Plum Analytics poster “Assessing Research Impact: New Metrics & Innovations.”

The Digital Shift (Oct. 1, Online)

image  Stop by the EBSCO booth during this online event to see PlumXTM.

Frankfurt Book Fair (Oct. 8 -12, Frankfurt, Germany)

image  Come to the EBSCO booth in Hall 4.2, Booth L1 and meet Mike Buschman and Stephan Buettgen and talk about PlumX. Email us if you want to set up a meeting.

SRA International (Oct. 18 - 22, San Diego, CA)

image   We are excited about our two presentations at the Society of Research Administrators annual meeting. Mike Buschman, Chief Product Officer and Co-Founder, will present on Monday, Oct. 20 at 2:00 “Measuring Your Researchers’ Output with PlumX” and on Wednesday, Oct. 22 at 11:45 “New Ways to Assess Research Impact.” Also, come to booth #202 to meet us and see a demo of PlumX.

Charleston Conference (Nov. 5 - 8, Charleston, SC)

image  We are participating on a panel titled “Help Your Researchers Get the Credit They Deserve” with Mark Hahnel, founder of figshare and Elaine Westbrook, Associate University Librarian for Research, University of Michigan on Friday, Nov. 7 at 3:15. 

RLUK 2014 (Nov. 12 - 14, Birmingham, UK)

image Come to the Lightning Talk we are doing on 13 November at 15:30 to learn more about PlumX and Plum Analytics.

USKG One-Day Conference (Nov. 20, London, UK)

image   Come to the Lightning Talk on 20 November at 15:30 to hear more about what is going with PlumX and Plum Analytics.

We hope to see you at one of these events. If not, and you would like to get in touch please go here.

With PlumXTM you can track metrics at multiple levels or group. For example, an academic institution might track metrics at:

  • Researcher
  • Lab
  • Department
  • Institution
  • Discipline
  • Subject

These groups are user-definable; each PlumX customer establishes their unique way to analyze research impact.

It is important to see research output information where you need it. With our Researcher Widget, a researcher can include information on their personal or institution pages. Below is an example of a researcher with the University of Pittsburgh.

image

In addition to seeing this information for an individual researcher, you can see it for any of the groups you define. In the example below, this is the Human Engineering Research Lab at Pitt.

image

You can see that this widget is for all of the researchers and research output for a given group, in this case a research lab. This would be perfect for the home page of the lab.

The widgets are highly configurable, and you can expand or hide certain sections.  For example, with just a few clicks on our wizard to build the widgets you can turn off many of the sections, and expand the number of artifacts you include.

image

This will then build a widget with the top 10 artifacts for the same group, and show  PlumTM Prints next to each of them.  This streamlined widget can then be embedded in pages to allow the user to both get a quick visualization of impact, and click through to see detailed metrics.

image

These new widgets complement our article or artifact level widget the Plum Print. You can read about that on our blog.

It is simple to implement these widgets with a few lines of code.

If you want more information about PlumX go here.

ORCID provides a persistent digital identifier that distinguishes you from every other researcher and, through integration in key research workflows such as manuscript and grant submission, supports automated linkages between you and your professional activities ensuring that your work is recognized.

image

Once the effort to create ORCID profiles for researchers has been done, you can now easily connect their scholarly activities with PlumXTM to track metrics about their research.

Specifically, PlumX uses the ORCID API to retrieve a list of the researcher’s public works and then uses the information to establish a PlumX researcher profile and gather metrics about the research’s impact. 

"ORCID addresses a problem shared by individuals and organizations across the research community: reliably connecting a researcher with their research, by embedding persistent identifiers into key research workflows. PlumX consumes ORCID-tagged data and provides a presentation layer that researchers can use to see who is using and talking about their research," said Laure Haak, Executive Director of ORCID.

In May, 2014, Plum Analytics was a proud sponsor of the ORCID Spring Outreach Meeting. We participated in the poster session showing our PlumX/ORICD integration. Below is the poster we presented.

image

What is significant about this integration is that after the ORCID information is integrated into PlumX the metrics about the research is viewable via the PlumX dashboard or through one of the Plum Analytics widgets - group, author and article.

image

In the future, we plan to create a PlumX profile for every ORCID profile so when you become a PlumX user your researchers with an ORCID profile will automatically be there.

For additional information about our ORCID integration read our press release here.

On July 31, Andrea Michalek, Plum Analytics President and co-founder, presented an hour-long webinar about altmetrics in general and PlumX, our research impact metrics dashboard, in particular.

You can watch that replay on YouTube here;

image

image

Pacifica Graduate Institute is an accredited graduate school located in Santa Barbara, CA offering masters and doctoral degree programs framed in the traditions in Depth Psychology. Half of the faculty is actively involved with research, while the other half are scholar practitioners with a focus on their practices.

One of the challenges at Pacifica is that because their faculty are in the social sciences, and a rather esoteric branch, their research does not fit the citation count method of assessing impact. Specifically, they produce a lot of monographs and presentations. They want to be able to showcase this research, but the usual tools would not work.

Alain Dussert, Director of Library Services, said he saw a presentation on altmetrics about a year ago and it opened his mind to the possibilities of tracking influence beyond citation counts. In his words, “Our faculty are esoteric and old school, but they do show up in monographs and YouTube presentations.”  When EBSCO acquired PlumTM Analytics, Dussert saw it as a validation of altmetrics and he seriously started looking at PlumXTM.

Pacifica became a PlumX customer in June, and since then they have loaded most of their faculty researchers and their research output, including monographs and YouTube videos. Dussert states that they have found how well PlumX deals with monographs, “WorldCat holdings are very useful.” First, they now have an easy way to see what libraries hold the monographs their faculty have created. Second, using the OCLC Control Number is a good way to track Pacifica research as not everything they’ve created has an ISBN. 

Below is a monograph published in 2011.

image

image

As you can see from the PlumX usage statistics, 45 libraries hold this book. If we investigate further, we can see also that there are 11 readers on Goodreads, and reviews and ratings on Amazon and Goodreads.

image

image

image

Dussert sees many uses of PlumX at Pacifica. For starters, he thinks his admissions department will use it to “show off rock stars to prospective students.” Another use is as a centralized location to show accrediting agencies the research that has been done.

Dussert is looking forward to using PlumX more and more because it is so flexible and can be used for many purposes.

We have hosted periodic webinars titled “Plum Analytics and Our Approach to Altmetrics.” Many people have attended and we have had good feedback. Since these webinars have been held during times that are inconvenient to many, we are offering it live two more times in early September for the rest of the world.

Title: Plum Analytics and Our Approach to Altmetrics
Who: Mike Buschman, Plum Analytics, Co-Founder & Chief Product Officer
Date: Thursday, September 4, 2014
Time: 11:00 am, Australia Eastern Standard Time (Sydney, GMT+10:00)
Register here

Title: Plum Analytics and Our Approach to Altmetrics
Who: Andrea Michalek, Plum Analytics, Co-Founder & President
Date: Wednesday, September 10, 2014
Time: 2:00 pm, BST (London, GMT +1:00)
Register here

image

image

Plum AnalyticsTM considers books an important research output or artifact, as demonstrated by our use of OCLC WorldCat metrics (see this blog for more information). We are now expanding our support of books with metrics from Goodreads.

Goodreads’ mission is to help people find and share books they love. With over 30 million members and 900 million books, Goodreads is the world’s largest site for readers and book recommendations. While Goodreads is a force in popular literature, the site also includes many important academic books, especially in humanities and social sciences.

Using the Goodreads API, PlumXTM now includes:

  • Goodreads Ratings
  • Goodreads Reviews
  • Goodreads Readers

Below is a psychology book authored by a researcher with a PlumX profile.

image

Here are the Captures and Mentions for this book. You can see that this book has 17 Goodreads readers and one review. 

image

You can click through to see the information at Goodreads.

image

Additionally, you can see the Goodreads rating (along with Amazon) right in PlumX.

image

We are excited to keep expanding PlumX with more metrics and more features. Stay tuned to this blog for more information.

imageSanford-Burnham Medical Research Institute is a non-profit medical research institute located in La Jolla California and Florida. Sanford-Burnham is one of the seven National Cancer Institute (NCI)-designated basic research cancer centers in the United States. Sanford-Burnham has over 80 full-time faculty all with their own labs and over 900 scientific staff members working on research. They have received over 170 NIH grants representing over $90 million in the last five years.

Jennifer Vigil, Librarian at Sanford-Burnham, said that at the same time a lot of people were asking questions about their grants, journal citation reports, and metrics about their publications, they had the opportunity to trial PlumXTM. According to Vigil, they seized the trial opportunity because they were going to have access to metrics that were not available through any of their traditional tools.

Since they implemented, Vigil reports having visibility into new ways people are interacting with their research, for example, Facebook Likes & Shares and capturing articles in Mendeley. Below is an article from Sanford-Burnhman’s PlumX that illustrates what Vigil is talking about. This article was just published in 2014, so has not had time to gather citations. Yet, with PlumX you can tell that there is already usage and social media attention, and 48 people capturing this article in Mendeley. These captures can be good indicators of future citations.

image

Sanford-Burnham is organized around fourteen programs so they set up their PlumX dashboard by program to see the metrics for each program. Some example programs are:

  • Bioinformatics and Structural Biology
  • Cardiovascular Pathobiology
  • Cell Death & Survival Networks
  • etc.

Within each program they have themes so it can be narrowed down even further. For example within the Bioinformatics and Structural Biology program there are two themes, Structural Bioinformatics/Systems Biology and System Biology of Microbes & Microbiome. They can see the metrics for the program, for both of these themes, as well as metrics for the researchers and their research output in the program.

Below is the first page of the Sanford-Burnham PlumX dashboard where you can see a list of programs. This page also displays the research output and their metrics for the entire organization.

image

"It’s been fun" says Vigil about implementing PlumX and dealing with the structure and the faculty and seeing metrics emerge as more and more PMIDs were put into the system. 

Taylor & Francis recently published their annual Open Access Survey. This is a survey they conducted of the authors they published during 2012. 

image

What interested us about the survey were the responses concerning usage statistics.

image

Sixty percent of the respondents said that usage and download statistics will become important for assessing the value of research over the next ten years. Only 12% said that they would not be important. While citations still rank (81%) as the most important way for assessing the value of research in the coming decade, it is clear that more and more authors are seeing the importance of the new ways people interact with and use research.

At PlumTM Analytics, we see this survey as validation of our view of altmetrics, or rather ALLmetrics since the definition of altmetrics does not include usage, nor do most altmetric providers.

When we developed PlumXTM there was growing attention to the role social media was playing in scholarly communications. We knew that Twitter, Facebook and others were becoming a big part of research promotion, and subsequently important to measure. But, we also knew that there were lots of other metrics that are important in understanding the impact of research. We set out to gather as many of those metrics as we could and categorize them in a meaningful way for clearer understanding. We wrote about this categorization in a previous blog.

One of those categories is Usage.

image   PlumX categorizes  a lot of activity in Usage including, Downloads, Views, Holdings and Video Plays.

Recently, we added usage statistics from EBSCO Databases, eBooks and EBSCO Discovery Service. You can read about this in more detail on our blog. By including this amount of usage across publishers, PlumX gives you a good proxy of the usage of articles and other research output.

Plum Analytics also makes it easy to show usage to your authors in your open access repositories.

image If you embed the PlumTM Print widget into your repository you can show your authors usage and other altmetric information. You can read more about the Plum Print in this blog post.

We can also include the usage statistics of the repository itself. That is exactly what some of our customers are doing. See this blog for more details and see this example below.

image

We are excited that we can help authors of Open Access articles assess the value of their research.

One of the things we looked forward to when considering our EBSCO acquisition was more collaboration between our companies. So, it is exciting to announce that PlumXTM now includes usage metrics for articles and books from EBSCO Databases, EBSCO Discovery Service and EBSCO eBooks.

image image    image

This marks the first time the wealth of information about the actual usage per article or book, such as abstract views, downloads, etc. can be measured across publishers. While we recognize that this does not represent all usage, it is a good proxy, and it gives you more usable information about articles and books.

One of our customers, Alain Dussert, Director of Library Services at Pacifica Graduate Institute, liked what he saw and commented, 

Wow, bringing in EBSCO usage stats is an impressive development. The benefits of being able to see EBSCO ‘hits’ by author is really going to bring tremendous amounts of relevant scholarly data to PlumX. That is a big, and I mean, big, development. I don’t think anyone has ever done that before, to be honest.

Below is an image of a PlumX Article page. You can also view it live here,

You can see that it includes EBSCO usage. Prior to adding this usage, this article indicated seven Mendeley readers. The Mendeley captures are an important statistic and indicate good interaction with this article. Now, with the addition of the EBSCO usage, you get a fuller picture of the level of interest in this article. 

image

Here is a closer view of the article level metrics:

image

Below is a list of the specific usage metrics we get from EBSCO Databases, EBSCO Discovery Service and EBSCO eBooks.

  • Abstract Views -  a view of the abstract
  • HTML Views -  a view of the HTML version
  • PDF Views - a view of the PDF version
  • ePub Downloads - a download of an ebook in epub format
  • Clicks - a click to request the item through EBSCO Smart Links or via Custom Links, such as ILL, OPAC, OpenURL, etc. when full text is not part of EBSCO
  • Plays - a play of an audiobook or video content
  • Supporting Data Views - a view of supporting data, figures or related images

Here is an article page with metrics in all five categories, Usage, Captures, Mentions, Social Media and Citations that includes EBSCO Usage. See it live here.

image

You can read more in our recent press release here.

It is our goal to give as complete a picture of research output - from articles and books to videos and web pages, and everything in between - as we can. We are very interested in working with publishers and others directly to include more usage data. Please email us if you are interested in discussing this further.

Autism Speaks is set to use PlumXTM to track the research impact of the research they fund.

Autism Speaks is the world’s leading autism science and advocacy organization, dedicated to funding research into the causes, prevention, treatments and a cure for autism; increasing awareness of autism spectrum disorders; and advocating for the needs of individuals with autism and their families. 

image

We are thrilled that this organization, which has spent over $200 million to fund autism research since they were founded, is using PlumX to track and evaluate this research.

Autism Speaks will use PlumX to track the metrics about the research outputs that their funding has helped create. Specifically, using PlumX, Autism Speaks will gather and analyze metrics at many levels and views. These include:

  • Grant ID
  • Researcher
  • Institution
  • Research Topic
  • Grant Type
  • Geography

By doing this, they will have powerful and actionable information about the research they fund. For the first time Autism Speaks will be able to tell the stories of impact behind what they are doing and have a better idea about the ROI of their funding. Furthermore, by opening this data, donors will see the impact of the funds they’ve donated, researchers can get credit for what they’ve done, and mentees will gain visibility.

We are really excited about working with Autism Speaks to implement their research grants with new metrics that can benefit the whole research community by enhancing the way we look at research impact and scholarly communication. 

To read the press release go here.

The key to quickly navigating complex data sets is to turn them into elegant, simple visualizations that do the hard work for you. We think our new PlumTM Print does exactly that. With one glance, it’s easy way to see the relative impact of each of the five categories of metrics - usage, captures, mentions, social media, citations - that we track (see this post for more information on these categories). A simple mouseover over the Plum Print quickly shows the metrics behind the visualization.

image

We have always included data visualizations as part of PlumXTM, in fact, one of our first data visualizations was the sunburst used to visualize a researcher’s output. We also wrote about this in a previous post.

The Plum Print is a natural evolution of that effort, designed to work at the artifact level, and carries forward the work we’ve done categorizing metrics. You can now see at a glance the impact of a given article, presentation, or any other research artifact.

In developing the Plum Print we learned that boiling down all of the metric information to a single number was like boiling down a home to just its purchase price. A $500,000 urban Victorian built in 1880 is different from the $500,000 brand new suburban home on a cul-de-sac. Sure, both are worth the same, but that number does not even come close to telling the stories of both homes. 

The Plum Print visually changes based upon the metrics in each category. Each circle of the Plum Print represents one of the five categories of metrics – Usage, Captures, Mentions, Social Media or Citations. By the size of the circle, you quickly visualize the relative number of metrics, and indeed, whether there are any metrics at all in a given category. 

In addition to creating the Plum Print, we updated our artifact page to make it easier to see impact. Here is an example of the new artifact page.

image

You still have the valuable and necessary information about the artifact, e.g. title, authors, journal, etc. Now, the metrics are easier to see and the impact is easier to grasp.

To see the evolution of PlumX for yourself, visit the demonstration site. If you’d like to see your own researchers in PlumX, write us at plumx@ebsco.com to request a trial.

To read our press release go here.

As a self-professed data junkie, I always thoroughly enjoy the yearly Internet Trends presentation from Mary Meeker from Kleiner Perkins Caufield & Byers.

One slide that jumped out talks about the very small percentage of data that is “tagged” and the even smaller amount of data that is “analyzed” in the Digital Universe.

image

(See all the slides here.)

These percentages hold true with what we have seen at Plum Analytics when looking at the data exhaust surrounding scholarly research output.  Although we cannot yet gather metrics for ALL output, we are increasingly able to quantify the engagement around an ever-growing set.

Working with our partners and customers, we continue to make progress on tagging and building analytics and dashboards for curated subsets of the world’s scholarly data. 

Drilling into the stat of why only 1% of the data in the digital universe is analyzed, it’s illustrative to think about just how fast this universe of data is expanding.  Below is a real time infographic that shows this expansion really well.

image

Note that the above image is just a sample of the data at PennyStocks.la, it is worth clicking through to see the live infographic.

At Plum Analytics, we’re excited to think about the opportunities of harvesting the firehose of data surrounding scholarly output, and utilizing it to tell the great stories of the impact that researchers are having.

We’re excited to announce that PlumX is Shibboleth enabled. Institutions and large enterprises can now authenticate PlumX in the way they are used to for subscription services. In addition the Shibboleth-enabled authorization also provides the identification process necessary to safeguard researchers’ profiles. By using this authentication method, PlumX knows who is using PlumX and allows for researchers to update their own profiles but not others. Likewise, other authorized users, such as a liaison librarian, can update specific researcher profiles, while preventing others from doing so.

From the beginning, we wanted to build products that met the needs of institutions. Supporting Shiobboleth in PlumX is one of the ways we are fulfilling this goal.

Click here to see the press release.

image

In my 11th grade biology class, with my lab partner, we dissected a fetal pig.  I remember the aha moment when I realized what the diaphragm was.  I had taken clarinet lessons for many years, and my teacher would always tell me to “breathe more with your belly, fill up your diaphragm”  I never quite understood what he was talking about, until, right before my eyes,  I could see that thin layer of muscle that ran across the abdomen of the animal.  And then, click, I understood.

With the advent of 3D printing, it’s amazing to think of all of the other things we can now see, and understand, in the blink of an eye.  For example, I saw this tweet recently:

image

With the work that we are doing at Plum Analytics, to visualize the impact of research, we are faced with a similar challenge.  How do we push forward the bounds of what is visible?  We sometimes compare the difference between what we measure with PlumX and altmetrics to visible light verus the full electromagnetic spectrum.

image

image

For centuries, all that people could see and measure was the visible light spectrum.  As instrumentation progressed, and better measurement tools were developed, we can now measure more.

For decades, the only tools that were instrumented to measure the impact of research came a time when journals were printed.  Measuring the quality of the journal that it was printed in, and the number of times other journal articles cited that work, was all that you could see and measure.

Now, with researchers and lay people interacting with research online, a whole new era of measurement can be possible.  We can discover who is interacting with the work, how much, across what channels, etc.  This enables us to better tell the stories behind the research that is being performed.

We love hearing your stories of how having access to this sort of data has enabled you to see what you could only imagine.  Please drop us a line at hello@plumanalytics.com.