Does own implementation of a published paper sufficient?

My answer on Quora

In my opinion, if it’s the sole contribution or novelty of the paper you are planning to publish, then I do not think it is sufficient for a new, separate publication.

You may make a technical report on it and upload it on arXiv. But, if you want to publish, then I think you have to do some more analysis and perform experiments to make the novelty of the paper significant.

Reproducibility Track at ECIR conference

You can also implement a set of related papers, possibly benchmark models on common datasets and compare their results and provide inferences. Some conferences like ECIR (European Conference on Information Retrieval) have started a “Reproducibility Track” specifically for such studies.

ECIR also strongly encourages the submission of reproducibility papers that repeat and analyze prior work.

In particular we solicit classical reproducibility papers, which replicate prior experiments and show how, why, and when the methods work (or not).

There are two common types of reproducibility papers:

Generalizability papers focus on assessing how well technology performs in new contexts (e.g., different time, location, access device, task), and

Predictability papers focus on developing theory and methods that assess and evaluate how generalizable methods are and whether they will work in other contexts.

ECIR website, Call for papers section

This is my answer on Quora to the question “Can we publish a paper on the implementation of an already published paper (implemented on a different platform)?

Related articles that may be of interest to you

You can get a comprehensive list of academic conferences in the field of AI and Machine Learning in another article written by me

If you are new to writing papers using Latex for academic conferences, you can visit the following articles:

  1. I cover how to setup up a Tex environment in your local machine (article link)
  2. Conference or journal paper template – individual files and how to use them (article link)
  3. How to correctly write references or perform cross-referencing while writing your paper (article link)

Please comment below if you would like to add something.

What is your take on this topic?