This paper presents the requirements for just in time knowledge management (JIT-KM). In order to deliver high-value information to user for decision-making, one must understand the user's preferences, biases and decision context. A JIT-KM architecture is presented consisting of user, middleware and data services to search for information from heterogeneous sources, and to rank and deliver this to decision-makers. The search process is described using concepts from Knowledge Sifter, an agent-based system that accesses heterogeneous sources using Semantic Web Services.