NORM_STANDARD npl_class: Parsing and Consolidation ?

[cverluise]

Hello,

Since v0.2-npl, we have introduced a NORM_STANDARD npl_class

Question

How should this class of citations be structured and consolidated?

Food for thoughts

Below is a sample of 100 citations for this class.

WITH
  tmp AS (
  SELECT
    npl_publn_id
  FROM
    `npl-parsing.patcit.v02_npl`
  WHERE
    npl_class="NORM_STANDARD")
SELECT
  npl_biblio
FROM
  `usptobias.patstat.tls214` AS tls214,
  tmp
WHERE
  tmp.npl_publn_id = tls214.npl_publn_id
LIMIT 100  

Row	npl_biblio
1	IEEE P802.11s/D2.0, Mar. 2008; Draft STANDARD for Information Technology-Telecommunications and information exchange between systems-Local and metropolitan area networks-Specific requirements-Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) specifications Amendment: Mesh Networking; IEEE 802 Committee of the IEEE Computer Society; 263 pages.
2	DIN/ISO 1629
3	3GPP TSG RAN#52; RP-110894; 'New Study Item Proposal: Mobile Relay for E-UTRA'; Bratislava, Slovakia, May 31-Jun. 3, 2011.
4	ISO/IEC 14496-2 International Standard, Information technology-coding of audio-visual objects-Part 2: visual, 2nd Edition, Amendment 2: Streaming video profile, Feb. 1, 2002, 61 pages.
5	3G TS 25.331 V3.3.0 3rd Generation Partnership Project Technical Specification Group Radio Access Network RRC Protocol Specification Release 1999, Jun. 2000, pp. 1-509, XP 002284353.
6	ANSI/IEEE Std 802.11, 1999 Edition; Information technology-Telecommunications and information exchange between systems-Local and metropolitan area networks-Specific requirements-Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) Specifications; LAN/MAN Standards Committee of the IEEE Computer Society; 528 pages.
7	ALCATEL LUCENT: 'Analysis of small data transmission solutions involving SMS in EPS', 3GPP TSG-SA WG3#64, S3-110648, JPN6016034418, 11 July 2011 (2011-07-11)
8	'Series H: Audiovisual and Multimedia Systems; Infrastructure of audiovisual services-Coding of moving video'. H.264. Advanced video coding for generic audiovisual services. Version 8. International Telecommunication Union. Dated Nov. 1, 2007.
9	SR-355
10	Information Science Institute: 'Internet Protocol, DARPA Internet Program Protocol Specification,' RFC 791, The Internet Engineering Task Force (IETF) Request for Comments, pp. 1-49, Sep. 1981.
11	ERICSSON ET AL.: 'Introduction of CA/MIMO capability signalling and measurement capability signalling in CA', RAN WG2, 3GPP TSG-RAN WG2 MEETING #72BIS R2-110604, 21 January 2011 (2011-01-21)
12	3GPP TS 36.213 V9.1.0, March 2010 (2010-03-01), pages 9 - 12
13	DIN 4102
14	Gattu, BalaSubrahmanyam, et al., 'Simple Network Management Protocol (SNMP) Agent System and Method,' Filing Date-Mar. 17, 2006, U.S. Appl. No. 11/378,023, Specification (35 pgs.) and Drawings (6 sheets).
15	Renesas Mobile Europe Ltd., 'Summary of email discussion [77#33] LTE: Mobility State Estimation Enhancements', R2-121850, 3GPP TSG-RAN WG2 #77bis, Mar. 2012, 24 pages.
16	Motorola. CQI Feedback for EUTRA. 3GPP TSG RAN WG1 Meeting #47bis. No. R1-070049. Jan. 15, 2007.
17	Chesson, Greg, 'The Protocol Engine Project' Technology Focus Sep. 1987.
18	Qualcomm Europe, Notion of Anchor Carrier in LTE-A, 3GPP TSG RAN WG1 Meeting #55-bis, Ljubljana, Slovenia, Jan. 12-16, 2009 (R1-080356).
19	Interdigital, 'Cell Reselection Issues during RRC Connection Establishment Procedure', 3GPP Tdoc R2-073178, 3GPP TSG-RAN WG2 #59, Athens, Greece, Aug. 20-24, 2007, 2 pages.
20	DIN 53132
21	QUALCOMM Europe, 'LTE RLC Sequence Numbering', Agenda Item: 6.4, Mar. 27-31, 2006, R2-061040, 3GPP TSG-RAN WG2 meeting #52, 3GPP (3rd Generation Partnership Project), Athens, Greece.
22	3GPP TS 23.401, V1.0.0 (May 2007) Technical Specification, 3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; GPRS enhancements for E-UTRAN access (Release 8); GSM Global System for Mobile Communications, 50 pages.
23	JPN6013009108; Ｂｏｋｉｎ　Ｂｏｂａｉ ｖｏｌ．３６　ｎｏ．７, 2008, ｐｐ．４３９-４４８
24	Gilad Bracha et al., 'Adding Generics to the Java Programming Language: Participant Draft Specification,' Apr. 27, 2001, 18 pages.
25	VOLA (RTM) Internet website http://web.archive.org/web/20110527002717/http://www.vola.com/Default.aspx?id=696 Dated 27 May 2011. Accessed using Web Archive on 25 June 2012.
26	'Part 16: Air Interface for Fixed Broadbank Wireless Access Systems', IEEE Std 802.16, 2004.
27	Samsung, 'Implicit ACK/NACK Multiplexing PUCCH CQI Sub-Frame Structure,' R1-073577, 3GPP TSG RAN WG1 Meeting #50, Agenda Item: 7.2.4, Athens, Greece, Aug. 20-24, 2007, 5 pages.
28	Google search 'cgi hit counter', WWN hit counter: does this work?, http://groups.google.com/group/comp.infosystems.gopherlbrowse-thread/thread/b4ef428d8c96d525/3e18b779b1 dad7ge?qcgi+hit+couonter&mum=74&..., printed on May 24, 2006, pp. 1-7.
29	Qualcomm Europe, 'Retransmission of NAS messages on the uplink during inter eNB Handover,' 3GPP TSG CT WG1 Meeting #52, C1-081138 (Apr. 7-11, 2008).
30	Massy, Dave 'Time Off for Good Behavior: DHTML Behaviors in Internet Explorer 5', (Mar. 1999),pp. 1-7.
31	IEEE Std 802.11b-2001 (Corrigendum to IEEE Std 802.11b-1999) 'IEEE Standard for Information technology- Telecommunications and information exchange between systems- Local and metropolitan area networks-Specific requirements, Part 11: Wireless LAN Medium Access Control (MAC) and Physical Layer (PHY) specifications, Amendment 2: Higher-speed Physical Layer (PHY) extension in the 2.4 GHz band-Corrigendum 1,' The Institute of Electrical and Electronics Engineers, Inc., Nov. 7, 2001.
32	Digital Cellular Telecommunications System (Phase 2); Technical Realization of the Short Message Service (SMS) Point-to-Point (GSM 03.40), ETSI, ETS 300 536, Fourth Edition, Oct. 1996.
33	Motorola, Joint Feedback for E-UTRA downlink preceding and COI [online], 3GPP TSG-RAN WG1#49b R1-072701, Internet .
34	Samsung: 'Uplink control signaling structure (Revision of R1-041086),' 3GPP TSG-RAN WG1 Meeting #38bis, Tdoc R1-041222, 3GPP, Sep. 20, 2004, URL: http://www.3gpp.org/ftp/tsg-ran/WG1-RL1/TSGR1-38bis/Dcs/R1-041222.zip.
35	'Technical Specification Group Services and System Aspects; General Packet Radio Service (GPRS) enhancements for Evolved Universal Terrestrial Radio Access Network (E-UTRAN) access', 3GPP TS 23.401 V11.4.0 (Release 11), (Dec. 2012), 284 pgs.
36	'Evolved Universal Terrestrial Radio Access (E-UTRA); Radio Resource Control (RRC); Protocol specification', 3GPP TS 36.331 V11.5.0. Technical Specification Group Radio Access Network. Release 11., (Sep. 2013), 347 pgs.
37	'Evaluation of MTC Device triggering', HTC, TD S2-110732, 3GPP TSG SA WG2 Meeting #83, (Feb. 2011), 2 pgs.
38	LG Electronics, et, al., 'Call flows for LIPA Solution1 Variant 1 with collocated H(e)NB and L-GW', TD S2-102883, 3GPP TSG SA WG2 Meeting #79, May 10-14, 2010, Kyoto, Japan.
39	'3GPP; TSG RAN; Evolved Universal Terrestrial Radio Access (E-UTRA); User Equipment (UE) Procedures in Idle Mode (Release 12', 3GPP TS 36.304 V12.2.0, 23 September 2014 (2014-09-23), Retrieved from the Internet URL:http://www.3gpp.org/dynareport/36304.htm
40	ASTM D412C
41	DataLogging: A Clinical Tool for Meeting Individual Patent Needs-Jan. 2005.
42	SERIES H: AUDIOVISUAL AND MULTIMEDIA SYSTEMS, Infrastructure of audiovisual services - Coding of moving video, Advanced video coding for generic audiovisual services, ITU-T Recommendation H.264, International Telecommunications Union, 11/2007.
43	ISO 5821 - Form D
44	IEEE 802.11-Protokolle
45	JPN7013002361; Ｐａｎａｓｏｎｉｃ: 'Ｖｉｅｗｓ　ｏｎ　ＣＳＩ-ＲＳ　ａｎｄ　Ｒｅｌ-８　ＣＲＳ　ｃｏｎｆｉｇｕｒａｔｉｏｎ［ｏｎｌｉｎｅ］' ３ＧＰＰ　ＴＳＧ-ＲＡＮ　ＷＧ１＃５８　　　　Ｒ１-０９３４５５ , 20090818, インターネット＜ＵＲＬ：ｈｔｔｐ：／／ｗｗｗ．３ｇｐｐ．ｏｒｇ／ｆｔｐ／ｔｓｇ＿ｒａ
46	3rd Generation Partnership Project, 3G TS 23.040 V5.4.0 (Jun. 2002)-Technical Specification; Technical Specification Group Terminals; Technical Realization of the Short Message Service (SMS); Release 5, 2002, pp. 1-181.
47	Federal Information Processing Standards Publication 197; Announcing the Advanced Encryption Standard (AES); Nov. 26, 2001.
48	NEC Group, 'PDSCH mapping issues in CoMP'3GPP TSG RAN WG1 Meeting#69, R1-122603, Prague, Czech, May 2012.
49	Third Generation Partnership Project, 'Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access (E-UTRA); Physical channels and modulation (Release 8),' 3GPP TS 36.211 V8.0.0 (Sep. 2007).
50	Marques et al. 'End-system support for BPG-signaled IP/VPNs' Network Working Group, Internet-Draft, Oct. 6, 2011, 16 pgs.
51	The International Engineering Consortium, 'H.323 Protocol Summary', Sep. 8, 1998.
52	Machine Translation JP2005-307778 Done 07/15/2013
53	Kim TS Invest Radiol 33(7): 1998 pp. 407-410, (printed in 5 pages).
54	Specification for RFID Air Interface EPC Radio-Frequency Identity Protocols Class-1 Generation-2 UHF RFID Protocol for Communications at 860MHz-960MHz Version 1.0.9 EPC global Inc. January 2005
55	3GPP2 X.50060-0; 3rd Generation Partnership Project 2 '3GPP2'; HRPD Support for Emergency Services, Version 1.0, (Jul. 2008), 18 pages.
56	LG Electronics Inc.: 'Framing in the MAC entity', 3GPP TSG-RAN WG2, R2-061012 [online], Mar. 27, 2006.
57	DIN EN 1125
58	MESA, LANCET ONCOL, vol. 6, 2006, pages 279 - 286
59	'3GPP Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access (E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRA); Overall Description; Stage 2 (Release 8),' 3GPP TS 36.300 V8.0.0, Mar. 2007, 82 pages.
60	LG ELECTRONICS: 'Issues on Multiplexing of WAN and D2D', R1-141354, 3GPP TSG RAN WG1 MEETING #76BIS, 22 March 2014 (2014-03-22), Shenzhen, China, Retrieved from the Internet URL:http://www.3gpp.org/ftp/tsg_ran/WG1_RL1/TSGR1_76b/Docs
61	ERICSSON: 'bidding down attack at eNB active mode handover', 《3GPP TSG SA WG3 #48 MEETING，S3-070554》
62	3G Americas, 'UMTS Evolution from 3GPP Release 7 to Release 8 HSPA and SAE/LTE', Jul. 2007, 89 pp.
63	ISO 10074 (1994(E))
64	ASTM D-1044
65	MINNEMA, M.C. ET AL., ARTERIOSCLER. THROMB. VASC. BIOL., vol. 20, 2000, pages 2489 - 2493
66	3GPP TS 36.423 V10.3.0; '3rd Generation Partnership Project: Technical Specification Group Radio Access Network; Evolved Universal Terrestrial Radio Access Network (E-UTRAN); X2 application protocol (X2AP); (Release 10)'; Sep. 2011 (132 pages).
67	'UE Identity in L1/L2 Downlink Control Signaling', 3GPP TSG-RAN WG 1#45, Sharp, May 8-12, 2006.
68	'Gigabit-Capable Passive Optical Networks (GPON): ONT Management and Control Interface Specification,' Draft Recommendation ITU-T, G.984.4, Amendment 2, 2008, 150 pages.
69	HUAWEI: 'Measurement Report for CSG cells', 《3GPP TSG_GERAN MEETING #45》
70	Mitsubishi LCP1 Supplemental Specification, Sep. 1996, pp. 1-20.
71	Standard Reference Guide for Installation of Residential Textile Floorcovering Materials, CRI 105 1990 ISBN 0 89275 030 8, p. 21, 30, 41, 47.
72	'Evolved Universal Terrestrial Radio Access (E-UTRA) and Evolved Universal Terrestrial Radio Access Network (E-UTRAN) Physical Channels', 3GPP TS36.300 (V8.8.0, March 2009 (2009-03-01)
73	J.S. LICWINKO, F.X. LUKAS: 'AT&T Fax Products And Services Speed The Written Message', AT&T TECHNOLOGY, vol. 4, no. 2, 1989, SHORT HILLS, NJ, US, pages 12 - 17, XP000086283
74	UE Fast Dormancy upon SRNS relocation,: R2-101939, Change Request 25.331 CR 4088 rev. 2, version 9.1.0, 3GPP TSG-RAN WG2 Meeting #69, San Francisco, Feb. 2010.
75	JPN6013008211; Ｈｕａｗｅｉ: 'Ｃｏｎｓｉｄｅｒａｔｉｏｎｓ　ｏｎ　ＤＣ-ＨＳＵＰＡ　Ｏｐｅｒａｔｉｏｎ' ３ＧＰＰ　ＴＳＧ　ＲＡＮ　ＷＧ１　Ｍｅｅｔｉｎｇ　＃５６ , 20090213
76	NTT DoCoMo, 'Physical Channels and Multiplexing in Evolved UTRA Downlink', 3GPP TSG RAN WG1 Ad Hoc on LTE, vol. R1-050590, Jun. 20, 2005, Sophia Antipolis, France, Retrieved from the Internet: URL: http://www.3gpp.org/ftp/tsg-ran/wgl-r11/TSGR-AH/, retrieved on Jun. 27, 2013, 24 pages, XP-002699699.
77	SAMSUNG (RAPPORTEUR): 'Email discussion report on [79b#34] [LTE/COMP] CoMP Open issues', 3GPP TSG-RAN WG2#80 R2-125718, JPN6017015530, 12 November 2012 (2012-11-12)
78	International Standard IEC 61847, First edition 1998-01, Ultrasonics-Surgical systems-Measurement and declaration of the basic output characteristics (C)IEC 1998.
79	Universal Serial Bus Micro-USB Cables and Connectors Specification, Revision 1.01; Apr. 4, 2007; p. 10; http://read.pudn.com/downloads114/doc/comm/476505/usb-20-040908/usb-20/Micro-USB-final/Micro-USB-1-01.pdf.
80	Bluetooth Media Center MMV-200, http://www.sonyericsson.com/spg.jsp?cc=us&lc=en&ver=4000&template=pp4-1-1&zone . . . , 2 pages, dated Jun. 16, 2006.
81	3GPP TSG RAN WG1 #49; 'Uplink Grant Capacity in Response to RAN2 LS'; R1-072532; Kobe, Japan; May 7-11, 2007; 7 pages.
82	3rd Generation Partnership Project (3GPP), TS 23.003 V7.8.0, 'Technical Specification Group Core Network and Terminals, Numbering, Addressing and Identification (Release 7)', Sep. 2008, pp. 1-54.
83	National Task Force on the Prevention and Treatment of Obesity 'Very low-calorie diets. National Task Force on the Prevention and Treatment of Obesity, National Institutes of Health' JAMA. Aug. 25, 1993;270(8):967-74.
84	IEEE-Standard 802.16
85	R1-105544 3GPP TSG RAN WG1 Meeting #62bis Xi'an, PR China, Oct. 11-15, 2010: Nokia Siemens Networks, Nokia 'Channel sounding enhancements for LTE-Advanced'.
86	ZTE, “Considerations on the detail procedure for FDM approach”, Agenda Item: 7.8.2, 3GPP TSG-RAN WG2 Meeting #72bis, R2-110243, Dublin, Ireland, Jan. 17-21, 2011.
87	R1-060712: 'Text Proposal for TR 25.814, Section 7.1.2.6, Ericsson' TSG-RAN WG1 #44, Denver, CO, USA, Feb. 13-17, 2006.
88	3GPP GROUP: '《3GPP TS 36.213 v9.3.0》', 30 September 2010, article 'E-UTRA Physical layer procedures'
89	DIN EN ISO 9237
90	DIN EN ISO 527-1/-2
91	'CI Plus Specification. Content Security Extensions to the Common Interface.', CI Plus Specification, Technical Specification, XP-002706380, v1.3 (Jan. 2011), 10 pages.
92	Unknown, Author, 'Coverage improvements for Further EUL Enhancements', 3GPP TSG-RAN WG2 #82 R2-131685 Fukuoka, Japan Source: Ericsson, ST-Ericsson, May 20-24, 2013, 1-4.
93	JPN7013001061; Ｑｕａｌｃｏｍｍ　Ｅｕｒｏｐｅ: 'Ｃｏｍｐａｒｉｎｇ　Ｒｅｌａｙ　Ｓｕｐｐｏｒｔ　ｗｉｔｈ　ＭＢＳＦＮ　ａｎｄ　Ｂｌａｎｋ　Ｓｕｂｆｒａｍｅｓ　［ｏｎｌｉｎｅ］' ３ＧＰＰ　ＴＳＧ-ＲＡＮ　ＷＧ１＃５５　Ｒ１-０８４５１５ , 20081110, ｐａｇｅｓ．１-４, インターネット＜ＵＲＬ：ｈｔｔｐ：／／ｗｗｗ．３ｇｐｐ．ｏｒｇ／ｆｔｐ／ｔｓｇ＿ｒａ
94	SolvSat (https://www.texwipe.com/products/wipers-all/by-wiper-type/pre-wet-wipers/industrial-wipers/solvent-cleaners/acetone.aspx) 2011, pg 1
95	'UE 'Fast Dormancy' Behaviour', 3GPP TSG-RAN WG2 Meeting #60, Vodafone, RIM, Huawei, Jeju, South Korea, Nov. 5-9, 2007, 4 pages.
96	Qualcomm Europe: 'Advantages of CoMP Operation for Delay Sensitive Traffic in CSG Environment', 3GPP Draft, R1-092694, Jun. 234, 2009, pp. 1-8.
97	3GPP, '3rd Generation Partnership Project; Technical Specification Group Radio Access Network; Radio Resource Control (RRC); Protocol specification (Release 10)', 3GPP TS 25.331 V10.2.0, Dec. 2010, 1-1834.
98	'Identification Cards-Recording Technique-Part 5: Location of Read-Write Magnetic Track-Trck 3', 21995, International Standard ISO.IEC 7811-5, Second Edition.
99	KARRY: '《javascript中的memoization(memoizing) 技术介绍》', 《PLAY GOOGLE》
100	W3C, 'XML Path Language (XPath) 2.0,' W3C Working Draft Dated Apr. 4, 2005, 89 pages.

Open questions

• Need for further sub-classification? If yes, which sub-classes?
• Fields to be parsed?
• Corpus/ reference database for consolidation?

On this specific class, @kermitt2 has precise ideas based on Grobid recent citation model update.

I leave these questions open to discussion.

Cheers

[cverluise]

Hello,

here are a thousand examples randomly drawn from the npl citations in the NORM_STANDARD class and their parsed representation (from grobid citation model @ 472324ac14e).

Extract query

WITH
  tmp AS (
  SELECT
    npl_publn_id
  FROM
    `npl-parsing.patcit.v02_npl`
  WHERE
    npl_class="NORM_STANDARD"
  LIMIT 1000)
SELECT
  tls214.*
FROM
  `usptobias.patstat.tls214` AS tls214,
  tmp
WHERE
  tmp.npl_publn_id = tls214.npl_publn_id

The current output is open for discussion. In particular, we are interested in:

• systematic errors in the classification which could help control/augment the training set efficiently
• systematic parsing errors. E.g. identification numbers not detected
• alignment of the grobid current parsing schema and the attributes of interest for this specific class of NPLs. E.g. should we add attributes? What would be the ideal set of attributes which standard data practitioners would like to find?

The file is available in .csv and .xlsx. It has the following variables:

• npl_publn_id: NPL publication id reported in PatStat 2018b
• npl_biblio: raw citation as reported in PatStat 2018b
• npl_grobid: parsed citation (grobid@472324ac14e citation model )

processed_sample-standard-norm-29032020.zip

Cheers