Discussion: View Thread

More on cross-citations affecting impact scores

  • 1.  More on cross-citations affecting impact scores

    Posted 08-01-2013 17:35

    Here is  a follow-up to my notes about two year Journal Impact Factors (JIFs) and our journals. I got into this because I'm working with John Cotton and another colleague on a paper on IS journals and as in our Entrepreneurship journals one I'm the numbers person. Knowing the new JIFs are out I took a look and was surprised by a few things, as noted in my first post: the very high JIF for the International Entrepreneurship and Management Journal (IEMJ) and the jump for a couple others including Management Decision (MD).

    Because JIFs are means and the distributions of citations are highly skewed the citation counts are strongly affected by the highly cited articles. Therefore, looking at the highly cited articles in IEJM one will immediately be struck by the number of citations by MD. I hadn't noticed the other journal that cites it a lot: Service Industries Journal (SIJ), because it didn't have a notable jump in the 2012 JIFs; in fact it fell. Here are the two year JIFs by year:

    JIF year:

    2010

    2011

    2012

    IEMJ

    na

    na

    5.053

    MD

    1.078

    1.302

    3.787

    SIJ

    1.071

    2.579

    1.017

     

    Naturally this leads to the question of the extent of cross-citations. Here is what I see, looking at the five most cited articles (according to Web of Science), with six for MD due to a tie. I used the two years prior to the highest (or only) JIF, as these are the citation years with that effect:

     

    most cited articles

    JIF year

    Total citations

    From MD

    From SIJ

    From IEJM

    % other two

    For IEMJ

    2012

    146

    42

    61

    10

    70.55%

    For MD

    2012

    247

    15

    109

    58

    67.61%

    For SIJ

    2011

    121

    5

    40

    37

    34.71%

     

    What we see here is that the strongest pattern of cross-citation was between SIJ and IEMJ. For example, of the 146 citations to the five most cited articles in IEMJ affecting the 2012 JIF, over 70% of them were from either MD or SIJ. As I noted, it doesn't take a microscope to see this. For example, in one striking case, a book review about Advances in Mergers and Acquisitions, appearing in MD (49(8), 1395-1400), cited 19 articles from SIJ.

     

    As our paper on the Entrepreneurship journals argues, citations can be a good objective measure of at one way of looking at the extent to which our writings actually matter. But we also argue that multiple measures, and human judgments are needed.


    Alex Stewart, Ph.D.
    Coleman Foundation Chair in Entrepreneurship
    Marquette University
    Milwaukee, WI 53201-1881
    Office: 414 288-7188
    ************************************** This message is from ENTREP which is sponsored by the Entrepreneurship Division of the Academy of Management. Please do not post messages with attached files. Commercial messages or spammed messages are not allowed on the list. The use of auto-responder "out-of-office" messages may also lead to your removal from the list. You can manage your subscription options, including joining or leaving the list here: http://aomlists.pace.edu/scripts/wa.exe?SUBED1=entrep&A=1 If you have questions or need help, please contact Dr. John Bunch jbunch@benedictine.edu. Ventures HO!