Methodology for calculating ratings in the information-and-analytical system for TRIZ Developers Summit “TDS-rating”

Methodology for calculating ratings in the information-and-analytical system for TRIZ Developers Summit “TDS-rating”

 

The methodology was approved for use at the session of the Coordination Council of the “TDS-rating” project on February 16, 2014. 

 

1. General provisions

Methodologies are developed based on the Regulations on Information-and-Analytical System for TRIZ Developers Summit “TDS-rating” and approved by the Coordination Council of the “TDS-rating” project.     

 

2. “TDS-rating” of publications on TRIZ issues

 

TDS-R-Pub = (Number of citations + 0.3* Number of self-citations +1)*Krelev*(Kexpert + 0.3)* Kavailability

 

 

Parameter

Description

Number of citations

Number of citations of a certain publication in other TRIZ-related publications stored in the TDS-rating database

Number of self-citations

Number of citations of a certain publication in other TRIZ-related publications written by the same author and stored in the TDS-rating database

Krelev

Coefficient of relevance, which takes into account to what extent a given publication is aimed at development of TRIZ as a science   

Kexpert

Expert evaluation of scientific research works on TRIZ for publications stored in the TDS-rating database

Kavailability

Level of availability

 

 

 

Coefficients

Value

Description and conditions

Krelev

1

Coefficient of relevance is taken to be equal to 1, if there are indications that the work in question is devoted to issues of TRIZ development as a science (the work can be also related to other subject matters as well). This value of coefficient is assigned if the article deals with development of certain TRIZ subsections, TRIZ tools and methodologies for their application.    

The value of this coefficient can be changed by the Chairperson of the Expert Committee of the Information-and-Analytical System “TDS-rating”

 

0.3

Devoted to the issues of TRIZ application in the practice of inventive problem solving, innovation activity or TRIZ training.

Or the article is referenced in the relevant article on TRIZ, though the article itself is not devoted to TRIZ issues.  

 

0

Is not devoted to TRIZ issues.

 

 

 

Kexpert= (Novelty x Actuality x Instrumentality x Reproducibility)0.25

 

1

Kexpert =1, if Krelev  is equal to 0.3 or 0

 

1

Kexpert =1, if Krelev  is equal to 1, but expert evaluation was not conducted

Novelty

5

At the date of publication, it is a new TRIZ tool or TRIZ branch   

 

4

Fundamental changes in known issues

 

3

Significant enhancement of known TRIZ tool or TRIZ branch

 

2

Noticeable improvement of known TRIZ tool or TRIZ branch

 

1

Insignificant changes

 

0

Absence of novelty or depreciation

Actuality

4

Actuality for TRIZ on the whole, for all directions of TRIZ application at the moment of article/report publication

 

3

Actuality for individual TRIZ branches and for certain directions of TRIZ application

 

2

Actuality for one specific TRIZ tool or TRIZ branch and only in restricted cases of its application

 

1

Actuality for special cases of application of specific TRIZ tool or TRIZ branch

 

0

Actuality is missing

Instrumentality

2

Proposed algorithms and notions are implemented in computer software

 

1.5

Clear algorithms and methodologies are proposed – with clear-cut explanation of rules for application. It is possible to teach people how to use them and it is possible to convert them into software program.   

 

1

Algorithms and rules are proposed, which can be interpreted in different ways

 

0.5

Recommendations of very general character with low degree of algorithmization are proposed  

 

0

It is impossible to obtain results based on presented description

Reproducibility

2

Results can be reproduced based on author’s documents

 

1.5

Results can be reproduced by many specialists after additional training

 

1

Results can be reproduced by individual specialists in the presence of the author

 

0.5

Results can be reproduced by author only

 

0

Nobody can implement the proposed approach

Kavailability

0.5

The article/work is practically unavailable in the Internet

 

1

The article/work is available, but not in English

 

1.1

The article/work and abstract are available in the Internet, but the abstract is only in English

 

1.3

The article/work is available in the Internet in English

 

 

 

3. TDS-ratingof TRIZ conferences

 

TDS-R-Conf = (∑ TDS-R-Pub / Narticles-conference)*Kyears*Kparticipants*Kintern*Kregularity*Kreviewing

where:

Narticles-conference – total number of articles submitted for a given conference;

Kyears – this is a coefficient taking into account the overall period of existence of a given conference; it is equal to 1, if the conference has been held for 3 years or less; it is equal to 1.1, if the conference has been held for 4-5 years; it is equal to 1.2, if the conference has been held for 6-9 years; it is equal to 1.3, if the conference has been held for 10 years or more;

Kparticipants – this is a coefficient taking into account the professional level of conference participants in TRIZ. If the number of TRIZ Masters and TRIZ specialists of the 4th level was from 80% to 100%, this coefficient is equal to 1.3; if the number of TRIZ Masters and TRIZ specialists of the 4th level was from 50% to 79%, this coefficient is equal to 1.2; if the number of TRIZ Masters and TRIZ specialists of the 4th level was from 25% to 49%, this coefficient is equal to 1.1; if less than 25%, Kparticipants = 1.

Кintern – this is a coefficient taking into account the geographic coverage of a conference. If over 10 countries, this coefficient is equal to 1.2; if from 9 to 4 countries, this coefficient is equal to 1.1; if participants from 3 countries or less, the coefficient is equal to 1.

Кregularity – this is a coefficient taking into account the regularity of a conference. If annual conferences without interruption, then Kregularity =1.3. If conferences were not held annually or there were interruptions – 1.2. If interruption period was equal to 2 years or more, – it is equal to 1.

Кreviewing – this is a coefficient taking into account the use of system for selecting articles and independent reviewing. If a system of independent reviewing has been used for the entire period of conference existence (or over 80% of the period of conference existence), the coefficient is equal to 1.3; if such a system has been used for lesser period of time or selection of article has been carried out without independent reviewers, then 1.2. In other cases, it is equal to 1.