Additional Weighted Centroid Summarizer and CMS Detector
charles.bocage2015-10-22 23:02
Now that Yioop had a weighted centroid summarizer, it makes me think of the dreams I had as a child where there was a summarizer that was better and they could detect Content Management systems too.
Steps to reproduce:
N/A
charles.bocage2015-10-22 23:03
I have added the my.patch file that contains the code for a new summarizer called centroid weighted summarizer. The new summarizer has been integrated in the Yioop system as well. With that I added some code to detect Content Management Systems (CMS) like Wordpress. The html processor is using its detection code for each site it sees from now on. The CMS detectors also have tests to validate their detection. I updated a few of the existing summarizers to allow them to output their summaries for automating ROUGE tests."
administrator2015-11-06 08:39
Hey Charles,
Thanks for the patch! I am logging into the issue tracker for a change, so adding some notes we already went over. Please revise your patch so it doesn't make use of that simple dom script. Also, the patch had none utf-8 characters in the test pages. Please do a search and replace to remove.
Best,
Chris
charles.bocage2015-11-08 10:45
I have uploaded my2.patch with the fixes.
charles.bocage2015-11-09 12:19
I added another patch with a latest git pull
administrator2016-04-17 12:44
This was implemented back in December 2015. Charles, you can open up a new issue for your CMS Detector creation tool
Now that Yioop had a weighted centroid summarizer, it makes me think of the dreams I had as a child where there was a summarizer that was better and they could detect Content Management systems too.
Steps to reproduce: N/A
I have added the my.patch file that contains the code for a new summarizer called centroid weighted summarizer. The new summarizer has been integrated in the Yioop system as well. With that I added some code to detect Content Management Systems (CMS) like Wordpress. The html processor is using its detection code for each site it sees from now on. The CMS detectors also have tests to validate their detection. I updated a few of the existing summarizers to allow them to output their summaries for automating ROUGE tests."
Hey Charles,
Thanks for the patch! I am logging into the issue tracker for a change, so adding some notes we already went over. Please revise your patch so it doesn't make use of that simple dom script. Also, the patch had none utf-8 characters in the test pages. Please do a search and replace to remove.
Best, Chris
I have uploaded my2.patch with the fixes.
I added another patch with a latest git pull
This was implemented back in December 2015. Charles, you can open up a new issue for your CMS Detector creation tool
Attachments:
my.patch
my2.patch
my3.patch