Maybe you’re thinking of something along the lines of Bishop Berkeley’s Theory of Immaterialism.

Essentially, things only exist and continue to exist because we agree that they do and expect them to remain that way.

Also featured in the children’s book Mr. Radagast Makes an Unexpected Journey, which I adored when I was younger.