Effective field theories of gravity: a top-down approach