Skip to content

Commit

Permalink
json on subjects
Browse files Browse the repository at this point in the history
  • Loading branch information
@Sadhana-Panthi
Sadhana-Panthi committed Dec 1, 2023
1 parent 73507ef commit 4faf04a
Show file tree
Hide file tree
Showing 4 changed files with 403 additions and 3 deletions.
7 changes: 4 additions & 3 deletions evaluating_gpt.py
View file
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
from openai import OpenAI
import json

client = OpenAI(api_key="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")


def get_score_from_gpt(question, clues_to_autograder, answer, student_answer):
Expand All @@ -13,13 +14,13 @@ def get_score_from_gpt(question, clues_to_autograder, answer, student_answer):
]
).choices[0].message.content


with open('data.json', 'r') as file:
filename="science.json"
with open(filename, 'r') as file:
data = json.load(file)

file = open("evaluating_gpt_results.txt", 'a')
for datum in data:
score = get_score_from_gpt(datum["question"], datum["clues_to_autograder"], datum["sample_answer"], datum["student_answer"])
print(datum["question"], datum["student_answer"], score)
file.write(datum["question"], datum["student_answer"], score)
file.write(f"Question: {datum['question']}\nStudent Answer: {datum['student_answer']}\nScore: {score}\n\n")
file.close()
215 changes: 215 additions & 0 deletions evaluating_gpt_results.txt
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,215 @@
computer
Question: what is oop?
Student Answer: OOP is object oriented programming.It is composed of classes and objects. It has functions like encapsulation, inheritance, polymorphism and so on. It is used by languages like C++, java, python, etc. It is considered more efficient than procedural oriented programming as it can be reused further and provides answer faster.
Score: {
"marks": 4,
"comment": "Your answer provides a basic understanding of OOP and its advantages, but it lacks depth and explanation of the concept of objects and classes. Try to focus more on programming principles and look for mention of objects and classes to understand the topic better."
}

Question: What is a data structure?
Student Answer: A data structure is a method for efficiently organizing and storing data. It involves defining relationships between data elements and specifying operations that can be performed on the data. It is also used for processing, retrieving, and storing data. There are different basic and advanced types of data structures that are used in almost every program or software system that has been developed.
Score: {
"marks": 8,
"comment": "Good explanation of the concept and its importance. However, the answer could have included more specific details about the relationships between data elements and the types of operations that can be performed. Additionally, it would be helpful to mention the significance of data structure in facilitating efficient operations."
}

Question: What is the output of the following Python code?

```python
print(3 + 5 * 2)
```
Student Answer: The code outputs 13 because multiplication has a higher precedence than addition.
Score: {
"marks": 10,
"comment": "Your answer demonstrates a clear understanding of operator precedence in Python. Well done!"
}

Question: Explain the difference between an array and a linked list.
Student Answer: An array is a fixed-size structure storing elements of the same type, whereas a linked list is dynamic, using nodes to store elements and pointing to the next node in the sequence.
Score: {
"marks": 7,
"comment": "Your answer provides a basic understanding of the difference between arrays and linked lists, but it lacks detail and explanation of the fixed-size and dynamic aspects. You also need to mention element storage and node connections in your explanation to show a comprehensive understanding of the topic."
}

Question: What is the time complexity of an algorithm?
Student Answer: Time complexity is a measure of how an algorithm's runtime scales with the size of the input. It assesses the efficiency of an algorithm as the input size increases.
Score: {
"marks": 9,
"comment": "Good explanation of time complexity and its relationship with input size. However, it would have been better if you had mentioned the importance of analyzing performance scalability in evaluating and comparing algorithms."
}

Question: What is an algorithm?
Student Answer: An algorithm is a step-by-step procedure designed to perform a specific task or solve a problem, offering a clear and defined solution. It is used for providing instructions to the computer in specified manner.
Score: {
"marks": 8,
"comment": "Good description of an algorithm as a step-by-step procedure for a specific task or problem. However, more elaboration on the significance and applications of algorithms could further enhance the answer."
}

Question: Explain the concept of Big O notation.
Student Answer: Big O notation describes the upper limit of an algorithm's time complexity growth, offering an asymptotic upper bound in the worst-case scenario.It is one of the most fundamental tools for computer scientists to analyze the cost of an algorithm.
Score: {
"marks": 8,
"comment": "Your answer provides a good understanding of Big O notation, but it could have included a bit more detail about how Big O notation abstracts away constant factors and lower-order terms for a clear comparison of algorithms. Also, it's important to mention the focus on growth rate in addition to time complexity. Great effort overall!"
}

Question: What is the purpose of a queue in data structures?
Student Answer: A queue, following First In, First Out (FIFO), stores elements with enqueue (add) and dequeue (remove) operations. We define a queue to be a list in which all additions to the list are made at one end, and all deletions from the list are made at the other end.
Score: {
"marks": 6,
"comment": "Your answer provides a basic understanding of the purpose of a queue in data structures, but it lacks depth and specific examples of real-world applications such as task scheduling and breadth-first search algorithms. Additionally, your explanation of enqueue and dequeue operations could be more explicit in describing their functionality."
}

Question: What is the significance of the 'this' keyword in OOP?
Student Answer: 'this' in OOP refers to the current instance of an object, distinguishing between instance and local variables.It is used to refer the current object.
Score: {
"marks": 8,
"comment": "Good understanding of the basic significance of 'this' in OOP. However, the explanation could be more detailed, and it lacks clarity in differentiating between variables."
}

Question: What is a constructor in object-oriented programming?
Student Answer: A constructor is a special method automatically called when creating an object. It initializes the object's attributes and performs setup tasks, ensuring a valid starting state. It prepares the new object for use, often accepting arguments that the constructor uses to set required member variables.
Score: {
"marks": 9,
"comment": "Good explanation of the purpose and functionality of a constructor. However, it would have been better to explicitly mention that the constructor is crucial for ensuring the object's validity and coherence. Also, make sure to expand on the importance of object initialization in object-oriented programming."
}

Question: What is the capital city of Nepal?
Student Answer: Kathmandu is the capital city of Nepal.
Score: {
"marks": 8,
"comment": "Good job on correctly identifying Kathmandu as the capital city of Nepal. However, you could have provided more information on its political, cultural, and economic importance to earn full marks."
}

Question: Name the major rivers that flow through Nepal.
Student Answer: Nepal has several major rivers, including the Koshi. These rivers are essential for agriculture.
Score: {
"marks": 5,
"comment": "The answer identifies one major river, but it is incomplete as it does not mention other major rivers in Nepal. Additionally, it only focuses on the role of rivers in agriculture and does not mention their importance in hydroelectricity and transportation."
}

Question: What is the significance of Mount Everest in Nepali culture and geography?
Student Answer: Mount Everest is of great cultural and geographical importance to Nepal. It symbolizes national pride, attracts tourists and mountaineers, and contributes to the country's unique topography as part of the Himalayan range.
Score: {
"marks": 8,
"comment": "Good understanding of the significance of Mount Everest in Nepali culture and geography. However, the answer could have been more descriptive and provided specific examples to further support the points made."
}

Question: Explain the caste system and its historical context in Nepal.
Student Answer: The caste system in Nepal is a social hierarchy with historical roots in Hinduism. It has assigned specific roles to different groups, influencing social, economic, and political aspects.
Score: {
"marks": 8,
"comment": "Good explanation of the historical roots of the caste system in Nepal and its influence on various aspects of society. However, the answer could be more comprehensive by including the mention of efforts to address caste-based discrimination and promote equality."
}

Question: Discuss the role of women in Nepali society and their contributions to various sectors.
Student Answer: Women in Nepal do not contribute significantly .
Score: {
"marks": 2,
"comment": "The answer lacks depth and a comprehensive understanding of the topic. It does not address the significant contributions of women in Nepali society to various sectors such as education, politics, and the workforce, nor does it mention the challenges and empowerment efforts. Please provide more thorough analysis and examples in your response."
}

Question: Describe the cultural festivals celebrated in Nepal and their significance.
Student Answer: Nepal celebrates a variety of cultural festivals, such as Dashain, Tihar, and Holi. These festivals are significant for fostering community bonds, expressing gratitude, and celebrating the diverse cultural heritage of the country.
Score: {
"marks": 10,
"comment": "Well done! Your answer is comprehensive and demonstrates a clear understanding of the cultural festivals celebrated in Nepal and their significance. Keep up the good work!"
}

Question: Explain the geopolitical position of Nepal and its implications on the country's history and relations.
Student Answer: Nepal's geopolitical position between India and China has had profound implications on its history and international relations. The country has balanced engagements with both neighbors while safeguarding its sovereignty.
Score: {
"marks": 8,
"comment": "The answer effectively explains Nepal's geopolitical position and its impact on history and international relations. However, it could provide more specific examples or details to enhance the completeness and understanding of the topic."
}

Question: Discuss the environmental challenges faced by Nepal and initiatives taken for sustainable development.
Student Answer: Nepal faces environmental challenges like deforestation, pollution, and climate change impacts. Initiatives for sustainable development include afforestation, waste management, and the promotion of renewable energy. The country prioritizes balancing environmental conservation with developmental needs.
Score: {
"marks": 10,
"comment": "Well done! Your answer is comprehensive and demonstrates a good understanding of the environmental challenges in Nepal and the initiatives for sustainable development. Keep up the good work!"
}

Question: Examine the historical and cultural significance of ancient Nepali architecture.
Student Answer: Ancient Nepali architecture, showcased in structures like the temples and palaces of the Kathmandu Valley, carries profound historical and cultural significance. These architectural marvels reflect artistic prowess, religious beliefs, and social dynamics, contributing to Nepal's rich cultural heritage.
Score: {
"marks": 9,
"comment": "The answer is quite comprehensive and demonstrates a good understanding of the topic. However, it could have been improved by providing specific examples of how the architectural marvels reflect the artistic prowess, religious beliefs, and social dynamics of the periods in which they were built."
}

Question: Explain the role of education in shaping Nepal's future and addressing social challenges.
Student Answer: Education is pivotal in shaping Nepal's future by addressing social challenges like poverty and inequality. Improving access,and inclusivity in education contribute to building a skilled workforce,and promoting social cohesion for a brighter future.
Score: {
"marks": 8,
"comment": "The answer effectively highlights the role of education in addressing social challenges such as poverty and inequality. However, it would have been more complete with mention of efforts to improve quality, and fostering innovation."
}

Question: Explain the process of photosynthesis and its significance in the context of Nepal's diverse plant life.
Student Answer: Photosynthesis is a process where plants take in sunlight and produce energy for themselves. It's important for plants to survive.
Score: {
"marks": 3,
"comment": "Your answer provides a basic understanding of photosynthesis, but it lacks details about the conversion of light energy to chemical energy, glucose and oxygen production, and its significance in Nepal's plant diversity. Try to elaborate on these key points to provide a more comprehensive answer."
}

Question: Discuss the impact of altitude on the physiological adaptations of animals in the high-altitude regions of Nepal, such as the Himalayas.
Student Answer: Animals in high altitudes have big lungs to breathe better, and they can fly higher.
Score: {
"marks": 2,
"comment": "Your answer shows a very basic understanding of the topic. You mentioned increased lung capacity, but there are other important physiological adaptations like efficient oxygen utilization that you missed. Also, your answer lacks depth and doesn't provide insights into the challenges and survival strategies of animals in high-altitude regions."
}

Question: Examine the role of microorganisms in soil fertility and nutrient cycling in Nepal's agricultural landscapes.
Student Answer: Microorganisms in the soil are harmful to plants and decrease nutrient levels.
Score: {
"marks": 2,
"comment": "The answer provided does not reflect a comprehensive understanding of the role of microorganisms in soil fertility and nutrient cycling. It overlooks the beneficial aspects of microbial activity in the soil and its contribution to sustainable agriculture practices in Nepal."
}

Question: Examine the environmental implications of Nepal's rapid urbanization and industrialization.
Student Answer: Rapid urbanization is great for the economy and doesn't have any negative effects on the environment.
Score: {
"marks": 2,
"comment": "The answer lacks completeness and understanding of the topic. It fails to mention the increased air and water pollution, habitat loss, and resource depletion associated with rapid urbanization. It also lacks insight into the importance of balancing economic development with environmental sustainability and the need for implementing green practices, waste management, and sustainable urban planning."
}

Question: Discuss the applications of biotechnology in enhancing crop productivity and food security in Nepal.
Student Answer: Biotechnology is not necessary for agriculture; traditional farming methods are sufficient for crop production.
Score: {
"marks": 2,
"comment": "Your answer does not demonstrate an understanding of the applications of biotechnology in enhancing crop productivity and food security in Nepal. You have not mentioned any specific biotechnology techniques or their contributions to agriculture in Nepal."
}

Question: Examine the role of genetics in the study of hereditary diseases prevalent in certain populations in Nepal.
Student Answer: Hereditary diseases are caused by bad luck and have nothing to do with genetics.
Score: {
"marks": 2,
"comment": "The answer shows a lack of understanding of the role of genetics in hereditary diseases and does not address the specific populations in Nepal as required."
}

Question: Discuss the impact of air pollution on the health of the population in urban areas of Nepal.
Student Answer: Air pollution doesn't affect human health; it's just a myth created by environmentalists.
Score: {
"marks": 0,
"comment": "The answer is factually incorrect and goes against the established knowledge on the impact of air pollution on health. It lacks understanding of the topic and does not address the specific concerns related to air pollution in urban areas of Nepal."
}

Question: Explain the role of renewable energy sources in mitigating climate change impacts in Nepal.
Student Answer: Climate change is a natural process, and human activities have no impact on it. Renewable energy is a waste of resources.
Score: {
"marks": 0,
"comment": "The answer does not address the role of renewable energy sources in mitigating climate change impacts in Nepal. It also presents an inaccurate understanding of climate change and renewable energy."
}

Question: Explain the concept of genetic engineering and its potential applications in healthcare in Nepal.
Student Answer: Genetic engineering is dangerous and should not be used in healthcare. It can lead to creating 'superhumans' with unknown consequences.
Score: {
"marks": 2,
"comment": "The response lacks understanding of the concept of genetic engineering and its potential applications in healthcare. It also seems to misinterpret genetic engineering as solely a risk without acknowledging its potential benefits in healthcare."
}

Question: Examine the scientific principles behind earthquake-resistant building designs and their application in Nepal's seismic zones.
Student Answer: Earthquakes are rare in Nepal, so there's no need for earthquake-resistant buildings. Traditional construction methods are sufficient.
Score: {
"marks": 1,
"comment": "The answer does not demonstrate an understanding of the scientific principles behind earthquake-resistant building designs and their application in Nepal's seismic zones. It overlooks the importance of implementing earthquake-resistant designs to mitigate risks in seismic zones."
}

Loading

0 comments on commit 4faf04a

Please sign in to comment.