There are certain factors that would determine that. Scientifically, phenotype(physical appearance) is determined by the combination of genotype(genetic composition) and environment. Usually, for a given gene, there is an allele(an alternative form of a gene that may occur at a given locus). For example, the gene height would have alleles-tall or short(T or t respectively). Now genes come in pairs and you inherit one each from both parents. these genes from both parent are you alleles for any trait. So assuming you are short and both your alleles for height are short(tt) like wise your partner, there aren't chances of having tall kids.
perhaps you have genes for tallness but it is recessive in you, there is a probability of you having tall kids and the level of probability would also depend on whether your partner has recessive genes for tallness as well. Let us say your kids inherit these genes. The environment to which they are exposed to will also determine the expression of this gene. Say for instance they grow up in a place where they do not get the proper nutrition they need at their formative years. This can hinder that trait from fully expressing.
There is the probablity that you might have kids that are short if both of you are short in size. The physical appearance is dependent on the genomes and DNA matchings.
Further more it also depends if you have the genomes of tall height but the recessive force is much larger that that of your genomes and your height became shorter but there is probablity that the child genomes of height would be stronger enough to overcome that problem and will become taller.