Large data loading

[RedantJParticipant]

This is a general question:

My current project requirement is to load 65,000+ records, with 32 entries per record.

Currently, the data is stored in SQL, and I’m using VBScript to load the records into 32 arrays in ASP Classic. I’m current optimising the code to cut down the loading time (I currently have it down to a half minute or so).

Would it be quicker to load the SQL data into a file and link the grid to the file URL instead?

Does anyone have a better idea of what to do?

[RedantJParticipant]

I answered my own question and the answer is, yes there is a better way.

Load only the entries needed into the grid (65,000+ records with 9 entries per record). That cuts down loading time.

The remaining entries are needed only for editing. So it makes sense to pull only for those entries for just that selected record which is accomplished by using an AJAX call:

$.ajax({
	type: "POST",
	url: "get.asp",
	data: "action=get&UID=" + UID,
	error: function(jqXHR, textStatus, errorThrown)
	{
		alert ("err: " + errorThrown);
		commit(false);
	}
})
.done(function(data) {
	var detaildata = JSON.parse(data);
	var foo = "<div class='jqx-rc-all' style='margin: 10px;'><b>Bar</b> " + detaildata.foo1 + "</div>";
	$(leftcolumn).append(foo);
});

In the ASP Classic controller (get.asp) program:

strIndex = Request.Form("UID")
intComp = StrComp(strAction, "get", vbTextCompare)

if (intComp = 0) then
	sql = "SELECT Foo FROM FooBar WHERE UID = " & strIndex
	Set rs = Conn.execute(sql)
	response.write ("{" & chr(34) & "foo1" & chr(34) & ":" & chr(34) & rs(0) & chr(34) & "}")
	response.flush()
	response.end()
end if

[Author]

Posts