Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Very HIgh MSE Loss #2

Open
GittyHarsha opened this issue Dec 1, 2024 · 2 comments
Open

Very HIgh MSE Loss #2

GittyHarsha opened this issue Dec 1, 2024 · 2 comments

Comments

@GittyHarsha
Copy link

GittyHarsha commented Dec 1, 2024

Epoch [95/100], Loss: 15795335555002138624.0000
Epoch [96/100], Loss: 15947571735960748032.0000
Epoch [97/100], Loss: 22230783709444833280.0000
Epoch [98/100], Loss: 24243408957763223552.0000
Epoch [99/100], Loss: 20029352523428003840.0000
Epoch [100/100], Loss: 26956084463393570816.0000
Mean Squared Error: 20261864048330539008.0000

I trained a simple neural network with 3 linear layers, relu and a dropout and Adam optimizer
class Net(nn.Module):
def init(self):
super(Net, self).init()
self.fc1 = Linear(12, 128)
self.fc2 = Linear(128, 64)
self.fc3 = Linear(64, 32)
self.fc4 = Linear(32, 1)
self.dropout = nn.Dropout(0.2)

def forward(self, x):
    x = torch.relu(self.fc1(x))
    x = self.dropout(x)
    x = torch.relu(self.fc2(x))
    x = self.dropout(x)
    x = torch.relu(self.fc3(x))
    x = self.dropout(x)
    x = self.fc4(x) 
    return x

The error seems to be very high.

Something is unique about the dataset.
A custom model tailored for this dataset is required

@GittyHarsha GittyHarsha closed this as not planned Won't fix, can't repro, duplicate, stale Dec 1, 2024
@GittyHarsha GittyHarsha reopened this Dec 1, 2024
@HridayM25
Copy link
Collaborator

HridayM25 commented Dec 1, 2024

You need to find the minima of the function given in the dataset. What you have done, you are trying to reduce the MSE loss between the fit NN and the target values. You have changed the objective function altogether here. Plus, scaling plays a big role in NN convergence. Try to scale the values

@GittyHarsha
Copy link
Author

ah ok

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants