I'm not sure that's a bad problem, as long as your OS (and your browser) reallocate memory efficiently when required. There's no need to treat RAM like your hard drive, and keep a certain amount free all of the time.
Also, your browser won't use 4GB of RAM if that's all you have.