Skip to content

Questions about gradient values #4

@shaoyangxu

Description

@shaoyangxu

Hello, i found the grad matrix(grad = weight.grad) has many non-zero elements while their corresponding values in weight matrix are zero, I want to ask why this happen(as a beginner of pytorch)? Thanks!

partial gradient matrix:
image

partial weight matrix:
image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions