Page 1
Page 2
Page 3
Page 4
Page 5
Page 6
Page 7
Page 8
Page 9
Page 10
Page 11
Page 12
Page 13
Page 14
Page 15
Page 16
Page 17
Page 18
Page 19
Page 20
Page 21
Page 22
Page 23
Page 24
Page 25
Page 26
Page 27
Page 28
Page 29
Page 30
Page 31
Page 32
Page 33
Page 34
Page 35
Page 36
Page 37
Page 38
Page 39
Page 40
Page 41
Page 42
Page 43
Page 44
33NewStudentProgramsNewStudentOrientationLeadersDEPARTMENTMISSIONSTATEMENTFrompre-admissiontograduationNewStudentProgramsprovidesservicesandprogramsdesignedtoempowerstudentsandtheirfamiliestocreateameaningfuleducationaljourneyatCalStateFullerton.NewStudentProgramsconnectsstudentstothevaluablelearningopportunitiesnecessaryforthisjourneyviacampustoursorientationprogramsinformationandcampusreferralsleadershipdevelopmentandwelcomeactivities.Asaresultofprogramparticipationandserviceutilizationstudentsdevelopcharactercriticalthinkingskillsandtheinterpersonalcompetencerequisiteforlifelonglearning.NewStudentProgramsprovidesinformationandresourcestoparentssothattheycanserveasactivepartnersintheirstudentsx19successfosterasenseofprideandcommunityamongparentsandfamiliesofCSUFstudentsandcultivatefundraisingopportunitiesamongthegrowingTitanParentsnetwork.NSPprogramsandservicesincludeNewStudentOrientationNSOTransferOrientationParentProgramsCampusToursTitanWOWStudentandVisitorInformationServicesAsktheTitansaswellasFreshmanPrograms.PROGRAMSERVICEOVERVIEWOrientationLeaderx13PublicSpeakingLearningOutcomesAssessmentThepublicspeakingskillsoftheOrientationLeadersareassessedusingarubric.Theleadersareassessedthreetimesthroughouttheirexperienceinordertohelpidentifygrowthduringtheirtimeintheposition.ToestablishtheirbaselevelpresentationskillstheirfirstpresentationisgiventoNewStudentProgramsstafflateMay.ThesecondrubricassessmentiscompletedbyoneoftheirfellowOrientationLeadershalfwaythroughtheirexperiencemidJune.ThethirdandfinalassessmentiscompletedbyaCSUFfacultystafforadministratorattheendoftheleaderx19sexperiencemidJuly.TYPEOFASSESSMENTStudentLearningOutcomesPROJECTSAMPLE80OrientationLeadersDATACOLLECTIONTIMEFRAMESummer200820092010and2011DATACOLLECTIONMETHODSPresentationobservationfeedbackisgiventhroughastandardizedrubricLIMITATIONSInter-raterreliabilityWhiletherubricattemptstoclarifyeachrankingwithdescriptivephrasesthereisinconsistencyinhoweachreviewerscoresx1cexpertx1dandx1cnovice.x1dRoomsizeinconsistencyThesizeofthegrouproomvariesfromonepresentationtothenextmakingconsistencyinscoringdifficultgroupscanvaryfrom10-150people.SUMMARYOFRESULTSAtotalof80leadershavegonethroughthethree-roundevaluationprocessduringthelastfouryears.Eachleaderisassessedin10differentareaswithascalerangingfromx1cnovicex1dtox1cexpert.x1dDuringthefirstroundofassessmentstherewereatotalof143x1cexpertx1drankingsgivenoverthelastfouryears.Duringthethirdroundofassessmentstherewereatotalof540x1cexpertx1drankingsassigned.Onaveragetheleadersincreasedtheirexpertrankingsby5duringthethirdroundofassessments.Thegraphbelowindicatestheincreasednumberofexpertrankingsoverthelastfouryears.In2010thefirstandsecondroundevaluatorswereencouragedtohavebriefmeetingswiththeleaderswhotheyevaluated.Ratherthanprovidegeneralcommentstheevaluatorswereinstructedtorelatetheirfeedbacktotherubriccategoriesinordertohelptheleadersenhancetheirskillsinamoretargetedway.Asthegraphaboveshowsthischangemayhaveenhancedthenumberofx1cexpertx1drankingsassignedinthesecondandthirdroundevaluationsin2010and2011.Ofthe80leaderswhocompletedthethreeroundsofevaluationsallbutfourleadersreceivedanincreasednumberofexpertratingsfromtheirfirsttothirdassessment.Whiletherubricattemptstoclarifyeachrankingwithdescriptivephrasesthereisinconsistencyinhoweachreviewerscoresx1cexpertx1dandx1cnovice.x1dIn2010thedatashowedthattherewasonefirstroundevaluatorwhoscoredtwopresentersveryhighly.Thetwopresentersevaluatedbythisoneindividualreceived10outof10expertrankingsduringthefirstround.Therewasasimilarfirstroundevaluatorin2011whorankedtwopresenterswithnearlyallx1cexpertx1drankings.Inallfourofthesecasesthepresentersreceivedfewerexpertrankingsduringtheirthirdroundassessmentultimatelyindicatingthattheyhadnotincreasedtheirpublicspeakingskillsbasedontherubricrankings.Howeverintheirfinalevaluationmeetingsthepresentersthemselvescommunicatedthattheyhadincreasedtheirskillsandcomfortlevelrelatedtopublicspeaking.Thechallengeinthissituationistheinter-raterreliabilityparticularlyinrelationtothefirstroundevaluators.Thetwoevaluatorswhogaveahighnumberofx1cexpertx1drankingswereStudentCoordinatorswhousedtherubricasanopportunitytoencouragetheirstaffinsteadofratingtheleadersbasedontheirdemonstratedskilllevel.