-
Notifications
You must be signed in to change notification settings - Fork 2
/
html2pdf21708-0.html
88 lines (88 loc) · 4.2 KB
/
html2pdf21708-0.html
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
<!DOCTYPE html>
<html xmlns="http://www.w3.org/1999/xhtml" lang="" xml:lang="">
<head>
<meta charset="utf-8" />
<meta name="generator" content="pandoc" />
<meta name="viewport" content="width=device-width, initial-scale=1.0, user-scalable=yes" />
<meta name="author" content="Dhruv Dhamani" />
<title>Why my Project is pointless</title>
<style type="text/css">
code{white-space: pre-wrap;}
span.smallcaps{font-variant: small-caps;}
span.underline{text-decoration: underline;}
div.column{display: inline-block; vertical-align: top; width: 50%;}
</style>
<!--[if lt IE 9]>
<script src="//cdnjs.cloudflare.com/ajax/libs/html5shiv/3.7.3/html5shiv-printshiv.min.js"></script>
<![endif]-->
</head>
<body>
<header>
<h1 class="title">Why my Project is pointless</h1>
<p class="author">Dhruv Dhamani</p>
</header>
<p>reveal<sub>height</sub>:1080 reveal<sub>width</sub>:1920 nums:nil</p>
<h1 id="intelligent-agent">Intelligent Agent</h1>
<p><img src="./ia.png" /></p>
<h1 id="an-example.">An example.</h1>
<ul>
<li>Book a spot for three at Maid-Rite Sandwich Shop in Antigua and Barbuda. I'll book a table for you at […]</li>
<li>Book a spot for three at Maid-Rite Sandwich Shop in Antigua and Barbuda. Which place? […]</li>
<li>Book a spot for three at Maid-Rite Sandwich Shop in Antigua and Barbuda. I'll book a table for […]</li>
</ul>
<h1 id="an-example.-1">An example.</h1>
<ul>
<li>Book a spot for three at Maid-Rite Sandwich Shop in Antigua and Barbuda. I'll book a table for you at <span class="underline">Maid-Rite Sandwich</span></li>
<li>Book a spot for three at Maid-Rite Sandwich Shop in Antigua and Barbuda. Which place? <span class="underline">Maid-Rite Sandwich</span></li>
<li>Book a spot for three at Maid-Rite Sandwich Shop in Antigua and Barbuda. I'll book a table for <span class="underline">three</span></li>
</ul>
<h1 id="roberta">RoBERTa</h1>
<p>RoBERTa iterates on BERT's pretraining procedure, including training the model longer, with bigger batches over more data; removing the next sentence prediction objective; training on longer sequences; and dynamically changing the masking pattern applied to the training data.</p>
<h1 id="roberta-1">RoBERTa</h1>
<ul>
<li>Bi-directional masked language model.</li>
</ul>
<h1 id="what-i-intended-to-do--">What I intended to do -</h1>
<ul>
<li>Book a spot for three at Eve's Pizzeria. Which place? <code><mask></code></li>
</ul>
<h1 id="what-i-intended-to-do---1">What I intended to do -</h1>
<ul>
<li>Book a spot for three at Eve's Pizzeria. Which place? <code><mask></code></li>
<li>Book a spot for three at Eve's Pizzeria. Which place? Eve's <code><mask></code></li>
<li>Book a spot for three at Eve's Pizzeria. Which place? Eve's Pizzeria</li>
</ul>
<h1 id="what-actually-happens--">What actually happens -</h1>
<ul>
<li><s> Book a spot for three at Eve's Pizzeria. Which place? </s></li>
</ul>
<h1 id="what-actually-happens---1">What actually happens -</h1>
<ul>
<li><s> Book a spot for three at Eve's Pizzeria. Which place? Eve's </s></s></li>
<li><s> Book a spot for three at Eve's Pizzeria. Which place? Eve's </s></s></s></s></s></s></s></s></li>
</ul>
<h1 id="how-to-get-it-to-work--">How to get it to work -</h1>
<ul>
<li>Don't use a birdirectional masked language model.</li>
<li>Examples of GPT2, a uni-directional transformer model trained for the same task -
<ul>
<li>add artist to All Out 70s . Where should I add ? All Out 70s</li>
<li>Give the current book a three . What is the rating ? three</li>
<li><a href="https://colab.research.google.com/drive/1MGDjZDdgzxZtAI_KO2yDEOkRmX3jj2LD" class="uri">https://colab.research.google.com/drive/1MGDjZDdgzxZtAI_KO2yDEOkRmX3jj2LD</a></li>
</ul></li>
<li>Do not use dynamic masking, as the orignal paper did, instead mask only the final answer.
<ul>
<li>What the paper did -
<ul>
<li>Book a <code><mask></code> for three <code><mask></code> Eve's Pizzeria. Which place? Eve's Pizzeria.</li>
</ul></li>
<li>Instead, do -
<ul>
<li>Book a spot for three at Eve's Pizzeria. Which place? <code><mask>
<mask></code></li>
</ul></li>
</ul></li>
</ul>
<h1 id="any-questions">Any questions?</h1>
</body>
</html>