Skip to content

NLP Project Notes: October 24

MythiliSankara edited this page Oct 24, 2019 · 1 revision

Tried Stanford CoreNLP and Spacy: Tried NeuroNER: a neural networks based NER with unannotated text

ORG: Organization Person: NORP: National or Religious Political Group GPE: Geo-political location

Tried on a small dataset with minimal training time. With the below is a sample results.

Jos—General Officer Commanding 3 Armoured Division of the Nigerian Army, Major General Jack Nwaogbo, has again re-assured Nigerians that the Boko Haram insurgency would soon be contained.

He spoke at the interdenominational service to commemorate this year’s Nigerian Army Day celebration held at the All Saints Military Church, Maxwell Khobe Cantonment, Rukuba, Jos, Plateau State, yesterday, urging Nigerians to bear a little more with the inconveniences caused by security measures in place in the state.

Nwaogbo, who was represented by Commander, 43 Division Engineers, Brigadier-General Bamidele Ogunkale, said everything was being done to end the Boko Haram menace, which he noted will soon become history.

He acknowledged that the security measures put in place as a result of the menace had been inconveniencing for citizens but noted that it was a necessary sacrifice to guarantee the security of all.

He said: “We used to drive freely to our churches. But now, we can no longer drive to our churches; we have to park somewhere very far and trek to church.

“We are no doubt living in a trying period but we appeal to Nigerians to be patient because all these attacks will soon be over. Boko Haram will soon wither away.

“Even as a general, I can’t drive out to wherever I like because there are times that instructions come at very short notices and I have to obey them because they are for our safety.”

The GOC called for prayers for security personnel, who he said had become targets of attacks, urging their family members to also bear the lack of attention from them because of the national assignments they are involved in.

Type: CARDINAL, Value: 3 Type: ORG, Value: the Nigerian Army Type: PERSON, Value: Jack Nwaogbo Type: NORP, Value: Nigerians Type: DATE, Value: this year Type: ORG, Value: Nigerian Army Day Type: ORG, Value: the All Saints Military Church Type: PERSON, Value: Maxwell Khobe Cantonment Type: GPE, Value: Rukuba Type: GPE, Value: Plateau State Type: DATE, Value: yesterday Type: NORP, Value: Nigerians Type: ORG, Value: Commander Type: CARDINAL, Value: 43 Type: ORG, Value: Division Engineers Type: NORP, Value: Nigerians Type: PERSON, Value: Haram

2)Nigerian Army Updates Officers On Operations Planning

As part of enhancing the proficiency of the officers on operation planning for joint and single service operations, officers of the Three Division of Nigeria Army were engaged in operational and administrative competencies of commanders at all levels particularly those involved in internal security operations.

General Officer Commanding Three Division, Major General Ebobowei Bona Awala, assured that the division will continue to work hand-in-hand with the various task forces in the areas of operations to ensure that piece is maintained and lives and property are secured in the region.

The training took place at the headquarters of the division, Maxwell Khobe Cantonment, Jos, North Central Nigeria and was targeted at knowledge acquisition and interaction for efficiency in internal security operations.

Awala expressed confidence that such programme will enhance efficiency among officers as they discharge their professional duties in addressing issues of terrorism and insecurity in the north east region.

Several topics relating to military planning and strategies ranging from levels of warfare and modern operating environment, operations planning procedure in single service and joint setting as well as essentials of logistics estimate in operations planning among others were discussed at the workshop as the various resource military officers present the papers.

Those who presented papers at the workshop include the Commander of the Special Task Force, Major General Henry Ayoola, Commander of Supply and Transport of the Division, Colonel Charles Idowu amongst others

Participants at the workshop are drawn from the brigade formations under the Three Divion comprising 21 Brigade, Maiduguri; 23 Brigade, Yola and 33 Brigade Bauchi.

Type: ORG, Value: Nigerian Army Updates Officers On Operations Planning

Type: ORG, Value: the Three Division of Nigeria Army Type: PERSON, Value: Ebobowei Bona Awala Type: ORG, Value: Maxwell Khobe Cantonment Type: ORG, Value: North Central Nigeria Type: LOC, Value: the north east region Type: ORG, Value: the Special Task Force Type: PERSON, Value: Henry Ayoola Type: ORG, Value: Supply and Transport of the Division Type: PERSON, Value: Charles Idowu Type: CARDINAL, Value: Three Type: CARDINAL, Value: 21 Type: GPE, Value: Maiduguri Type: CARDINAL, Value: 23 Type: ORG, Value: Yola Type: CARDINAL, Value: 33 Type: PERSON, Value: Brigade Bauchi

Observations: Words attached before or after Person names get included and are collectively understood as location. But not always. Maxwell Khobe Cantonment was recognized both as a person and an organization.

It misses some named entities. It misidentifies locations as organizations. Also, Haram is a name but a Boko Haram should be an organization.

Deepdive annotation issues:

Deepdive does not seem to work with BRAT annotations and accepts only sql, csv/tsv and json formats. I tried converting the files into jsons but it generated errors. The annotation tool Mindtagger and if we do not use the that, we would need to change a lot of the default schema provided. By Deepdive.

Below is the Jupyter notebook:

https://nbviewer.jupyter.org/github/HazyResearch/deepdive/blob/master/examples/spouse/DeepDive%20Tutorial%20-%20Extracting%20mentions%20of%20spouses%20from%20the%20news.ipynb

DDlog does seems to accept only name and relation.

Also deepdive compilation takes more than an hour on a small dataset.

Clone this wiki locally