ICT705 Data and System Integration

ICT705 Data and System Integration – Task 2 Page 1 of 12ICT705Data and System IntegrationTask 2Semester 1, 2020ICT705 Data and System Integration – Task 2…

ICT705 Data and System Integration – Task 2 Page 1 of 12ICT705Data and System IntegrationTask 2Semester 1, 2020ICT705 Data and System Integration – Task 2 Page 2 of 12Assessment and Submission DetailsMarks: 40% of the Total Assessment for the CourseDue Date: 11:59pm Friday, 22nd May 2020 (Week 12)Submit your assignment to Blackboard Task 2. Please follow the submission instructions inBlackboard.The assignment will be marked out of a total of 100 marks and forms 40% of the totalassessment for the course. ALL assignments will be checked for plagiarism by SafeAssignsystem provided by Blackboard automatically.Refer to your Course Outline or the Course Web Site for a copy of the “Student Misconduct,Plagiarism and Collusion” guidelines.Late submission will be penalised according to the policy in the course outline. Please noteSaturday and Sunday are included in the count of days late.Requests for an extension to an assignment MUST be made to the course coordinator priorto the date of submission and requests made on the day of submission or after the submissiondate will only be considered in exceptional circumstances. Assignment submission extensionswill only be made using the official University guidelines.ICT705 Data and System Integration – Task 2 Page 3 of 12Background: Queensland Fire and Emergency ServicesGiven the recent outbreak of bush fires across the country the Queensland Fire and EmergencyServices (QFES) have noted deficiencies in their current systems. After evaluating various platforms,the QFES are considering a Service Oriented Architecture (SOA) for its future IT infrastructure.However, they would like to gain a deeper understanding of the technologies and have asked for ademonstration of these technologies along with a brief explanation of the concepts and principles ofhow it works.Specifically, they have asked you to provide a demonstration web page in which the user will input aregion from a drop box and click a button to display a google map with the locations of fire stationsin the region.Data for this assignment is based on data collected from Queensland Government websites,specifically:Station_Locations.xml was constructed from RuralFireStations.csvQueensland Fire and Emergency Services – Rural Fire Stations dataset by Queensland Fire andEmergency Services from Open Data Portal (CC BY 4.0)Queensland_Regions.csv and Stations.csv was constructed from data contained on web pagesQueensland Fire and Emergency Services – Regions by Queensland Fire and Emergency Services (CCBY 4.0)Data from these two sources were downloaded and underwent some significant manipulation andcleaning to produce the input files for your assignment, as working with the original data sourceswas deemed too difficult for the course.For those students looking for a challenge, you should try writing code that automatically extractsand merges data from the original two sources, to experience a real-life example of the problems ofdata integration even within one organisation (unfortunately no extra marks can be given for this).ICT705 Data and System Integration – Task 2 Page 4 of 12Assignment TasksThis assignment consists of two deliverables, being: 1. Demonstration code 50%, and 2.Report 50%.1. Demonstration Code – That must be uploaded to Blackboard Task 2 – Code2. Report – That must be uploaded to Blackboard Task 2 – Report.Important informationThe following instructions must be adhered to, failing to do so will lead to significant penalty. Priorto submitting your assignment, you should go through this checklist to ensure you have followed theinstructions. If you do not understand any of the instructions, please ask your tutor.Submission Check List

Instructions CompletedYou are to submit a zip file containing a folder that contains yourdemonstration code. The folder must be named: Task 2 – Your Name –Student Number (note replace “Your Name” and “Student Number” withyour actual name and student number). The zip file must be named thesame as the folder it contains.Penalty – Loss of 20% of marks for Deliverable 1 Demonstration Code.For tasks 1 & 2 below, your python code may only import / use the followingmodules (libraries): re, csv, xml, json, petl & bottle.Penalty – use of any library other than those specified, Zero Marks for the TaskThe zipped folder must contain all files necessary to execute your demo(excluding Python). That is all source code files, petl and bottle libraries andinput files.Penalty – Loss of 20% of marks for Deliverable 1 Demonstration Code.You may submit only one HTML file containing all your javascript andoptionally one CSS file. Use of multiple HTML files or any additional filessuch as JS is not permitted.Penalty – Zero Marks for Task 3Report submitted as a Microsoft Word DocumentPenalty – Submitting report in any other format such as .PDF will result in ZeroMarks for Report FormatYour report must contain appropriate citations (inline text referencing) ofsources of information. Your reference list must list all citations in yourreport.Penalty – Zero marks for the section where citations were required and possiblyadditional penalties relating to academic misconductThe appendices of your report must contain your source code fromdeliverable 1 in text format (not as images)Penalty – Zero marks for Deliverable 1 Demonstration Code

CookMyProjectICT705 Data and System Integration – Task 2 Page 5 of 12Deliverable 1 – Demonstration CodeYou are asked to provide a demonstration web page in which the user will input a region from a dropbox and click a button to display a google map with the locations of fire stations in the region.All code relating to this assignment should be contained within a folder named: Task 2 –Your Name – Student Number, the folder is then to be zipped and uploaded to blackboard.(note replace “Your Name” and “Student Number” above with your actual name andstudent number. The folder must then be compressed in a zip file named the same as thefolder it contains and uploaded to Blackboard under Task 2 – Code.For ease of demonstration, your code must be self-contained. The folder must contain your sourcecode files, input files, output file from task 1, petl and bottle modules if you use them.Whilst the tasks below may be achieved in many ways the client QFES has restricted your use ofpython libraries to the following: re, csv, xml, json, petl & bottle. Use of any other module or librarywill result in zero marks for task 1 and/or task 2 in which they were used.Task 1 – Data integration demo.To demonstrate your code, you have been provided with three data sources compiled withdata from QFES. These are:• “Stations.csv” contains information about the fire stations,• “Station_Locations.xml” contains the location coordinates for each fire station• “Queensland_Regions.csv” contains a list of regionsYou have also been supplied with Fire_Station_Locations (Solution).csv”, that you can useto check the correctness of your implementation, or if you are unable to complete some oftask 1.You are to submit a python script named “data_integration.py” and your output“Fire_Station_Locations.csv”Your script should clean and merge data into one CSV file named“Fire_Station_Locations.csv” with the following fields (attributes):

Field Name MappingRegionID Queensland_Regions.RegionIDStation Number Stations.StnNumberStation Name Stations.Station NameStation Type Stations.StnTypeStreet Address Stations.Address

ICT705 Data and System Integration – Task 2 Page 6 of 12

State New Calculated FieldPostcode New Calculated FieldPhone Number Stations.PhoneFax Number Stations.FaxE-Mail New Calculated FieldLatitude Station_Locations.LatLongitude Station_Locations.Long

Table 1 – Field MappingTask 1.1 Create a Postcode field (3 marks)Extract and remove the postcode from the Stations Address field into a new “Postcode” field.Task 1.2 Create a State field (2 marks)Create a new field and set the value to “Qld”Task 1.3 Create E-Mail (4 marks)An email address for each station needs to be constructed from its name: e.g. the addressfor Acacia Ridge Fire Station will be [email protected] 1.4 Merge Data (5 marks)You are to merge data from the three sources into “Fire_Station_Locations.csv” with fieldsas shown in Table 1 – Field Mapping.Task 1.5 Correct Field Names (2 Marks)Ensure your field names match the fields as shown in Table 1 – Field Mapping .Task 1.6 Correct Field Order (2 Marks)Ensure the order of fields matches the order in Table 1 – Field MappingTask 1.7 Sort Data (2 Marks)Data must be sorted firstly on “RegionID” and then on “Station Number”Note: Should you be unable to fully complete the above tasks, you have been supplied witha file “Fire_Station_Locations (Solution).csv” that you can use for Task 2.Task 2 – RESTful Web Service DemoYou are to submit a python script named “data_services.py”.For tasks 2.1 to 2.2 Your script should build a RESTful web service that supports a‘getstations’ query from the client browser similar to “/getstations?regionid=x”. The serverWeb Service will return a JSON table with the following fields (attributes): Station Number,Station Name, Street Address, State, Postcode, Phone Number, Email, Latitude, Longitude.ICT705 Data and System Integration – Task 2 Page 7 of 12Data is to come from the “Fire_Station_Locations.csv” you built in task 1 (or,“Fire_Station_Locations (Solution).csv” if you were unable to fully complete task 1).Task 2.1 Return stations for a region (4 marks)The server will return a table of records (tuples) of fire stations in the region passed to it.Task 2.2 Return all fire station (3 marks)In the advent of a call to “getstations?regionid=0”, the server will return a list of all firestations.Task 2.3 List of Regions (3 marks)To populate your drop-down list in task 3.1 you will need to return a JSON table of allrecords from “Station_Regions.csv” with the following fields (attributes): RegionID, RegionName. The server should respond to a “getregions” request.Task 3 Mashup DemoYou are to submit a HTML file “stations_map.html” and optionally a CSS file named“stations_map.css”. For ease of marking all JavaScript must be contained in your HTML file.Task 3.1 Form Layout (5 marks)You are to create an input form that accepts user input for a Queensland region. The inputfor the Queensland region should be a drop-down list with the first item being “All Regions”with a value = 0 remaining items should be created dynamically from a call to getregionsfrom task 2.3. This input should be accompanied with a “Display Stations” button andappropriate descriptors / information on the operation of the web page.Task 3.2 Google Map (6 marks)Clicking the “Display Stations” button will trigger a “getstations” web service to retrieve atable of stations matching the region with attributes described in task 2. From this data youare to display a Google map marking the position of the returned stations.Task 3.3 Label Markers (2 marks)Markers on the map should be labelled with the “Station Number”ICT705 Data and System Integration – Task 2 Page 8 of 12Figure 1 – Markers labelled with Station NumbersTask 3.4 Centred & Zoomed (2 marks)The map should be centred on the region and zoomed to an appropriate level to show allfire stations in the region selected.Task 3.5 Information Window Demographics (3 marks)Upon clicking a marker bubble on the map, the user will be displayed an informationwindow containing: Station, Address (including State & Postcode), Phone and a clickableemail address.Figure 2 – Demographic WindowTask 3.6 Information window email (2 marks)Clicking an email address link in the information window should launch the user’s emailapplication and automatically insert the subject line “Enquiry”.ICT705 Data and System Integration – Task 2 Page 9 of 12Deliverable 2 – ReportYou are required to write a report explaining the key concepts around the design andimplementation of your demonstration system. You are also required to explain how to runyour code. Finally, you are to include all code submitted in the appendices to the report.Your report should be no less than 1000 words and it would be best to be no longer than1500 words. Note that the code will not count towards the word count. Your report shouldfollow the following template:Executive SummaryTable of ContentsTable of Figures (if needed)Table of Tables (if needed)1.0Introduction2.0Key System Concepts2.1 Service Oriented Architecture (SOA)2.2 Data Cleaning & Merging2.3 RESTful Web Services2.4 Web Page Design3.0Demo Running Instructions4.0Conclusion & RecommendationsReference ListAppendicesAppendix 1 – Data_integration.pyAppendix 2 – Data_Services.pyAppendix 3 – Stations_map.htmlExecutive Summary, Introduction, Conclusion & Recommendations (5 Marks)Please follow the conventions detailed in:Summers, J. & Smith, B., 2014, Communication Skills Handbook, 4th Ed, Wiley, Australia.2.1 Service Oriented Architecture (SOA) (15 marks)You are to explain the potential use of a SOA by the QFES. In your discussion you should provide ascholarly definition of SOA, reasons SOA may be useful or not useful.2.2 Data Merging and Cleaning (5 marks)Provide a scholarly definition of data merging and data cleaning.What specific issues did you face when merging data from the three sources into one source?ICT705 Data and System Integration – Task 2 Page 10 of 122.3 RESTful Web Services (5 marks)Provide a scholarly definition of REST.How could your demo be modified to ensure data is current?2.4 Mashups (5 marks)Provide a scholarly definition of Web Mashups and AJAX.Describe how the concepts of a mashup and AJAX were incorporated into your demo?3.0 Demo Running Instructions (10 marks)Given your client QFES has limited technical knowledge, you are to provide instructions for gettingthe ZIP file you supplied (the one you uploaded to Blackboard) up and running. You should presumethat they have a new workstation with a clean installation of Windows to test your demo.Report Format (5 marks)The report must be formatted using the following guidelines:• Paragraph text 12-point Calibri single line spacing• Code Text 12-point Courier new single line spacing• Headings Arial in an appropriate type size• Margins 2.5cm on all sides• Title Page is not to contain headers, footers, or page numbering• Header is to display the Report Title (excluding the title page)• Footer to display your name and the page number (excluding the title page)• Title Page – Must not contain headers or footers. Include your name as the report’sauthor.• Page numberingo Executive summary to the last page of Table of Figures / Table of Tables to useroman numerals (i, ii, iii, iv)o Introduction and onwards to use conventional numerals (1, 2, 3, 4) starting atpage 1 from the introduction• The report is to be created as a single Microsoft Word document (version 2007, 2010,2013, 2016, or Office 365). No other format is acceptable and doing so will result inthe deduction of marks.• The report must use the built-in features of Microsoft Word to create page numbers,section numbers, citations, cross referencing of sections, figures and tables, table ofcontents, table of figures, table of tables, and bibliography.ICT705 Data and System Integration – Task 2 Page 11 of 12Reference List (0 marks)Please note that whilst there are no specific marks for referencing, it is expected, that asmasters’ students, that the source of all material is referenced. Please note the marks givento sections 2.1 to 2.3 will be based on the quality of your references, and that failure toreference material will result in few if any marks and potentially lead to a charge of academicmisconduct. Please also note you are to submit a Reference List not a Bibliography, thus onlyreferences citated in your report should appear in your reference list.References should follow the Harvard method of referencing. Note that ALL references shouldbe from journal articles, conference papers, technical papers or a recognized expert in thefield. DO NOT use Wikipedia as a reference. The use of unqualified references will result inthe deduction of marks. The exception to this is where you have copied code or based yourcode on a source in which case make a comment in your code acknowledging the source andinsert a citation in your report (the quality of the source is not important, if you use it,reference it).Appendices (0 marks)You are to submit, in text format, the code you have written for data_integration.py,data_services.py, stations_map.html and stations_map.css (if applicable).NOTE: failure to include your code will result in ZERO marks being awarded forDeliverable 1 – Demonstration Code, and likely result in an investigation intoSuspected Academic Misconduct.Assignment Return and Release of GradesAssignment grades will be available on the blackboard in two weeks after the submission. Anelectronic assignment marking sheet will be available at this time. Where an assignment isundergoing investigation for alleged plagiarism or collusion the grade for the assignment andthe assignment will be withheld until the investigation has concluded.ICT705 Data and System Integration – Task 2 Page 12 of 12Assignment AdviceThis assignment will take several weeks to complete and will require a goodunderstanding of application and information integration technologies for successfulcompletion. It is imperative that students take heed of the following points in relation todoing this assignment:1. Ensure that you clearly understand the requirements for the assignment – whatmust be done and what are the deliverables.2. If you do not understand any of the assignment requirements – Please ASKyour tutor or course coordinator if your tutor cannot resolve your problem.3. Each time you work on any aspect of the assignment reread the assignmentrequirements to ensure that what is required is clearly understood.4. Prior to submitting your code, you should ensure not only that it executes asrequired, but also looks professional. It is expected that you adhere to HTML andpython standards for naming and indenting. All methods should be adequatelydocumented such that another programmer examining your code will readilyknow what the code is doing.Plagiarism and Collusion Advice1. All work must be submitted through SafeAssign.2. SafeAssign will pick up any similarities between work online as well as work fromother students (in this semester and previous)3. Please make sure you reference your work properly. If you are using any materialfrom the internet or any books from the library, you need to cite the workcorrectly. Failure to do so will result in possible cases of Academic Misconduct.4. Please do not share your work with other students. Do not give anyone your filesto have a look. SafeAssign will pick up collusion, but keep in mind thepercentages for Collusion may not report accurately until all student assignmentshave been submitted. Both the person copying and the person providing willpotentially be held accountable.5. You can submit a draft assignment through SafeAssign before making the actualsubmission.6. If you need any advice or are unsure about referencing, please speak with USCStudent services for assistance.

Let’s block ads! (Why?)

Do you need any assistance with this question?
Send us your paper details now
We’ll find the best professional writer for you!

 



error: Content is protected !!