title: Latent Space Analysis of VAE and Intro-VAE applied to 3-dimensional MR Brain Volumes of Multiple Sclerosis, Leukoencephalopathy, and Healthy Patients

abstract: Multiple Sclerosis (MS) and microvascular leukoencephalopathy are two distinct neurological conditions, the first caused by focal autoimmune inflammation in the central nervous system, the second caused by chronic white matter damage from atherosclerotic microvascular disease. Both conditions lead to signal anomalies on Fluid Attenuated Inversion Recovery (FLAIR) magnetic resonance (MR) images, which can be distinguished by an expert neuroradiologist, but which can look very similar to the untrained eye as well as in the early stage of both diseases. In this paper, we attempt to train a 3-dimensional deep neural network to learn the specific features of both diseases in an unsupervised manner. For this manner, in a first step we train a generative neural network to create artificial MR images of both conditions with approximate explicit density, using a mixed dataset of multiple sclerosis, leukoencephalopathy and healthy patients containing in total 5404 volumes of 3096 patients. In a second step, we distinguish features between the different diseases in the latent space of this network, and use them to classify new data.


title: Generating Attribution Maps with Disentangled Masked Backpropagation

abstract: Attribution map visualization has arisen as one of the most effective techniques to understand the underlying inference process of Convolutional Neural Networks. In this task, the goal is to compute an score for each image pixel related with its contribution to the final network output. In this paper, we introduce Disentangled Masked Backpropagation (DMBP), a novel gradient-based method that leverages on the piecewise linear nature of ReLU networks to decompose the model function into different linear mappings. This decomposition aims to disentangle the positive, negative and nuisance factors from the attribution maps by learning a set of variables masking the contribution of each filter during back-propagation. A thorough evaluation over standard architectures (ResNet50 and VGG16) and benchmark datasets (PASCAL VOC and ImageNet) demonstrates that DMBP generates more visually interpretable attribution maps than previous approaches. Additionally, we quantitatively show that the maps produced by our method are more consistent with the true contribution of each pixel to the final network output.


title: Learning from pandemics: using extraordinary events can improve disease now-casting models

abstract: Online searches have been used to study different health-related behaviours, including monitoring disease outbreaks. An obvious caveat is that several reasons can motivate individuals to seek online information and models that are blind to people's motivations are of limited use and can even mislead. This is particularly true during extraordinary public health crisis, such as the ongoing pandemic, when fear, curiosity and many other reasons can lead individuals to search for health-related information, masking the disease-driven searches. However, health crisis can also offer an opportunity to disentangle between different drivers and learn about human behavior. Here, we focus on the two pandemics of the 21st century (2009-H1N1 flu and Covid-19) and propose a methodology to discriminate between search patterns linked to general information seeking (media driven) and search patterns possibly more associated with actual infection (disease driven). We show that by learning from such pandemic periods, with high anxiety and media hype, it is possible to select online searches and improve model performance both in pandemic and seasonal settings. Moreover, and despite the common claim that more data is always better, our results indicate that lower volume of the right data can be better than including large volumes of apparently similar data, especially in the long run. Our work provides a general framework that can be applied beyond specific events and diseases, and argues that algorithms can be improved simply by using less (better) data. This has important consequences, for example, to solve the accuracy-explainability trade-off in machine-learning.


title: Symmetric-Constrained Irregular Structure Inpainting for Brain MRI Registration with Tumor Pathology

abstract: Deformable registration of magnetic resonance images between patients with brain tumors and healthy subjects has been an important tool to specify tumor geometry through location alignment and facilitate pathological analysis. Since tumor region does not match with any ordinary brain tissue, it has been difficult to deformably register a patients brain to a normal one. Many patient images are associated with irregularly distributed lesions, resulting in further distortion of normal tissue structures and complicating registration's similarity measure. In this work, we follow a multi-step context-aware image inpainting framework to generate synthetic tissue intensities in the tumor region. The coarse image-to-image translation is applied to make a rough inference of the missing parts. Then, a feature-level patch-match refinement module is applied to refine the details by modeling the semantic relevance between patch-wise features. A symmetry constraint reflecting a large degree of anatomical symmetry in the brain is further proposed to achieve better structure understanding. Deformable registration is applied between inpainted patient images and normal brains, and the resulting deformation field is eventually used to deform original patient data for the final alignment. The method was applied to the Multimodal Brain Tumor Segmentation (BraTS) 2018 challenge database and compared against three existing inpainting methods. The proposed method yielded results with increased peak signal-to-noise ratio, structural similarity index, inception score, and reduced L1 error, leading to successful patient-to-normal brain image registration.


title: Birational Geometry of moduli spaces of pointed curves

abstract: This is the authors doctoral thesis written at the Humboldt-University Berlin. It contains material from the three separate papers: "On the Kodaira dimension of the moduli space of nodal curves", "On quotients of $\overline{\mathcal{M}}_{g,n}$ by certain subgroups of $S_n$" and "The moduli space of hyperelliptic curves with marked points".


title: Temporal Evolution of Prompt GRB Polarization

abstract: The dominant radiation mechanism that produces the prompt emission in gamma-ray bursts (GRBs) remains a major open question. Spectral information alone has proven insufficient in elucidating its nature. Time-resolved linear polarization has the potential to distinguish between popular emission mechanisms, e.g., synchrotron radiation from electrons with a power-law energy distribution or inverse Compton scattering of soft seed thermal photons, which can yield the typical GRB spectrum but produce different levels of polarization. Furthermore, it can be used to learn about the outflow's composition (i.e. whether it is kinetic-energy-dominated or Poynting-flux-dominated) and angular structure. For synchrotron emission it is a powerful probe of the magnetic field geometry. Here we consider synchrotron emission from a thin ultrarelativistic outflow, with bulk Lorentz factor $\Gamma(R)=\Gamma_0(R/R_0)^{-m/2}\gg1$, that radiates a Band-function spectrum in a single (multiple) pulse(s) over a range of radii, $R_0\leq R\leq R_0+\Delta R$. Pulse profiles and polarization evolution at a given energy are presented for a coasting ($m=0$) and accelerating ($m=-2/3$) thin spherical shell and for an off-axis top-hat jet with sharp as well as smooth edges in emissivity. Four different magnetic field configurations are considered, such as a locally ordered field coherent over angular scales $\theta_B\gtrsim1/\Gamma$, a tangled field ($B_\perp$) in the plane transverse to the radial direction, an ordered field ($B_\parallel$) aligned in the radial direction, and a globally ordered toroidal field ($B_{\rm tor}$). All field configurations produce distinct polarization evolution with single (for $B_\perp$ and $B_\parallel$) and double (for $B_{\rm tor}$) $90^\circ$ changes in the polarization position angle.


title: A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning

abstract: Autonomous vehicles need to handle various traffic conditions and make safe and efficient decisions and maneuvers. However, on the one hand, a single optimization/sampling-based motion planner cannot efficiently generate safe trajectories in real time, particularly when there are many interactive vehicles near by. On the other hand, end-to-end learning methods cannot assure the safety of the outcomes. To address this challenge, we propose a hierarchical behavior planning framework with a set of low-level safe controllers and a high-level reinforcement learning algorithm (H-CtRL) as a coordinator for the low-level controllers. Safety is guaranteed by the low-level optimization/sampling-based controllers, while the high-level reinforcement learning algorithm makes H-CtRL an adaptive and efficient behavior planner. To train and test our proposed algorithm, we built a simulator that can reproduce traffic scenes using real-world datasets. The proposed H-CtRL is proved to be effective in various realistic simulation scenarios, with satisfying performance in terms of both safety and efficiency.


title: Few Shot Dialogue State Tracking using Meta-learning

abstract: Dialogue State Tracking (DST) forms a core component of automated chatbot based systems designed for specific goals like hotel, taxi reservation, tourist information, etc. With the increasing need to deploy such systems in new domains, solving the problem of zero/few-shot DST has become necessary. There has been a rising trend for learning to transfer knowledge from resource-rich domains to unknown domains with minimal need for additional data. In this work, we explore the merits of meta-learning algorithms for this transfer and hence, propose a meta-learner D-REPTILE specific to the DST problem. With extensive experimentation, we provide clear evidence of benefits over conventional approaches across different domains, methods, base models, and datasets with significant (5-25%) improvement over the baseline in a low-data setting. Our proposed meta-learner is agnostic of the underlying model and hence any existing state-of-the-art DST system can improve its performance on unknown domains using our training strategy.


title: Quantifying residual stress in Helium implanted surfaces and its implication for blistering

abstract: Helium implantation in surfaces is of interest for plasma facing materials and other nuclear applications. Vanadium as both a representative bcc material and a material relevant for fusion applications is implanted using a Helium ion beam microscope, and the resulting swelling and nanomechanical properties are quantified. These values are put in correlation to data obtained from micro residual stress measurements using a focused ion beam based ring-core technique. We found that the swelling measured is similar to literature values. Further we are able to measure the surface stress caused by the implantation and find it approaches the yield strength of the material at blistering doses. The simple calculations performed in the present work, along with several geometrical considerations deduced from experimental results confirm the driving force for blister formation comes from bulging resulting mainly from gas pressure buildup, rather than solely stress induced buckling.


title: Demystifying Pythia: A Survey of ChainLink Oracles Usage on Ethereum

abstract: Smart contracts are dependent on oracle systems for their adoption and usability. We perform an empirical study of oracle systems' usage trends and adoption metrics to provide better insight into the health of the smart contract ecosystem. We collect ChainLink usage data on the Ethereum network using a modified Ethereum client and running a full node. We analyze the collected data and present our findings and insights surrounding the usage trends, adoption metrics, oracle pricing and service quality associated with ChainLink on the Ethereum network.


title: Extensions of definable local homomorphisms in o-minimal structures and semialgebraic groups

abstract: We state conditions for which a definable local homomorphism between two locally definable groups $\mathcal{G}$, $\mathcal{G^{\prime}}$ can be uniquely extended when $\mathcal{G}$ is simply connected (Theorem 2.1). As an application of this result we obtain an easy proof of [3, Thm. 9.1] (see Corollary 2.2). We also prove that Theorem 10.2 in [3] also holds for any definably connected definably compact semialgebraic group $G$ not necessarily abelian over a sufficiently saturated real closed field $R$; namely, that the o-minimal universal covering group $\widetilde{G}$ of $G$ is an open locally definable subgroup of $\widetilde{H\left(R\right)^{0}}$ for some $R$-algebraic group $H$ (Thm. 3.3). Finally, for an abelian definably connected semialgebraic group $G$ over $R$, we describe $\widetilde{G}$ as a locally definable extension of subgroups of the o-minimal universal covering groups of commutative $R$-algebraic groups (Theorem 3.4)


title: On the Spherical Slice Transform

abstract: We study the spherical slice transform which assigns to a function on the $n$-dimensional unit sphere the integrals of that function over cross-sections of the sphere by $k$-dimensional affine planes passing through the north pole. These transforms are well known when $k=n$. We consider all $1< k < n+1$ and obtain an explicit formula connecting the spherical slice transform with the classical Radon-John transform over $(k-1)$-dimensional planes in the $n$-dimensional Euclidean space. Using this connection, known facts for the Radon-John transform, like inversion formulas, support theorems, representation on zonal functions, and others, can be reformulated for the spherical slice transform.


title: Exploring Adversarial Robustness of Multi-Sensor Perception Systems in Self Driving

abstract: Modern self-driving perception systems have been shown to improve upon processing complementary inputs such as LiDAR with images. In isolation, 2D images have been found to be extremely vulnerable to adversarial attacks. Yet, there have been limited studies on the adversarial robustness of multi-modal models that fuse LiDAR features with image features. Furthermore, existing works do not consider physically realizable perturbations that are consistent across the input modalities. In this paper, we showcase practical susceptibilities of multi-sensor detection by placing an adversarial object on top of a host vehicle. We focus on physically realizable and input-agnostic attacks as they are feasible to execute in practice, and show that a single universal adversary can hide different host vehicles from state-of-the-art multi-modal detectors. Our experiments demonstrate that successful attacks are primarily caused by easily corrupted image features. Furthermore, we find that in modern sensor fusion methods which project image features into 3D, adversarial attacks can exploit the projection process to generate false positives across distant regions in 3D. Towards more robust multi-modal perception systems, we show that adversarial training with feature denoising can boost robustness to such attacks significantly. However, we find that standard adversarial defenses still struggle to prevent false positives which are also caused by inaccurate associations between 3D LiDAR points and 2D pixels.


title: Neutrino-4 anomaly: oscillations or fluctuations?

abstract: We present a deep study of the Neutrino-4 data aimed at finding the statistical significance of the large-mixing short-baseline neutrino oscillation signal claimed by the Neutrino-4 collaboration at more than $3\sigma$. We found that the results of the Neutrino-4 collaboration can be reproduced approximately only by neglecting the effects of the energy resolution of the detector. Including these effects, we found that the best fit is obtained for a mixing that is even larger, close to maximal, but the statistical significance of the short-baseline neutrino oscillation signal is only about $2.7\sigma$ if evaluated with the usual method based on Wilks' theorem. We show that the large Neutrino-4 mixing is in strong tension with the KATRIN, PROSPECT, STEREO, and solar $\nu_{e}$ bounds. Using a more reliable Monte Carlo simulation of a large set of Neutrino-4-like data, we found that the statistical significance of the Neutrino-4 short-baseline neutrino oscillation signal decreases to about $2.2\sigma$. We also show that it is not unlikely to find a best-fit point that has a large mixing, even maximal, in the absence of oscillations. Therefore, we conclude that the claimed Neutrino-4 indication in favor of short-baseline neutrino oscillations with very large mixing is rather doubtful.


title: Experimental determination of the magnetic interactions of frustrated Cairo pentagon lattice materials

abstract: We present inelastic neutron scattering measurements of the Cairo pentagon lattice magnets Bi$_2$Fe$_4$O$_9$ and Bi$_4$Fe$_5$O$_{13}$F, supported by high field magnetisation measurements of Bi$_2$Fe$_4$O$_9$. Using linear spin wave theory and mean field analyses we determine the spin exchange interactions and single-ion anisotropy in these materials. The Cairo lattice is geometrically frustrated and consists of two inequivalent magnetic sites, both occupied by Fe$^{3+}$ ions and connected by two competing nearest neighbour interactions. We found that one of these interactions, coupling nearest neighbour spins on the three-fold symmetric sites, is extremely strong and antiferromagnetic. These strongly coupled dimers are then weakly coupled to a framework formed from spins occupying the other inequivalent site. In addition we found that the Fe$^{3+}$ $S=5/2$ spins have a non-negligible single-ion anisotropy, which manifests as a spin anisotropy gap in the neutron spectrum and a spin-flop transition in high field magnetisation measurements.


title: QUBIC IV: Performance of TES Bolometers and Readout Electronics

abstract: A prototype version of the Q & U bolometric interferometer for cosmology (QUBIC) underwent a campaign of testing in the laboratory at Astroparticle Physics and Cosmology laboratory in Paris (APC). The detection chain is currently made of 256 NbSi transition edge sensors (TES) cooled to 320 mK. The readout system is a 128:1 time domain multiplexing scheme based on 128 SQUIDs cooled at 1 K that are controlled and amplified by an SiGe application specific integrated circuit at 40 K. We report the performance of this readout chain and the characterization of the TES. The readout system has been functionally tested and characterized in the lab and in QUBIC. The low noise amplifier demonstrated a white noise level of 0.3 nV.Hz^-0.5. Characterizations of the QUBIC detectors and readout electronics includes the measurement of I-V curves, time constant and the noise equivalent power. The QUBIC TES bolometer array has approximately 80% detectors within operational parameters. It demonstrated a thermal decoupling compatible with a phonon noise of about 5.10^-17 W.Hz^-0.5 at 410 mK critical temperature. While still limited by microphonics from the pulse tubes and noise aliasing from readout system, the instrument noise equivalent power is about 2.10^-16 W.Hz^-0.5, enough for the demonstration of bolometric interferometry.


title: Genetics and Pathophysiology of Maturity-onset Diabetes of the Young (MODY): A Review of Current Trends

abstract: Single gene mutations have been implicated in the pathogenesis of a form of diabetes mellitus (DM) known as the maturity-onset diabetes of the young (MODY). However, there are diverse opinions on the suspect genes and pathophysiology, necessitating the need to review and communicate the genes to raise public awareness. We used the Google search engine to retrieve relevant information from reputable sources such as PubMed and Google Scholar. We identified 14 classified MODY genes as well as three new and unclassified genes linked with MODY. These genes are fundamentally embedded in the beta cells, the most common of which are HNF1A, HNF4A, HNF1B, and GCK genes. Mutations in these genes cause beta-cell dysfunction, resulting in decreased insulin production and hyperglycemia. MODY genes have distinct mechanisms of action and phenotypic presentations compared with type 1 and type 2 DM and other forms of DM. Healthcare professionals are therefore advised to formulate drugs and treatment based on the causal genes rather than the current generalized treatment for all types of DM. This will increase the effectiveness of diabetes drugs and treatment and reduce the burden of the disease.


title: Some remarks and properties of algebras obtained by the Cayley-Dickson process

abstract: Finding identities in nonassociative algebras plays an important role in the study of properties of these algebras. In this paper, we present some identities in alternative algebras and in algebras obtained by the Cayley-Dickson process. Moreover, the spectrum of matrices with coefficients in such algebras are investigated.


title: A simple finite delayed multi-type branching process for infectious disease modeling

abstract: We study a model for the spread of an infectious disease which incorporates spatial and temporal effects. The model is a delayed multi-type branching process in which types represent geographic regions while infected individuals reproduce offspring during a finite time interval and have convalescence times and random death/recovery outcomes. We give simple expressions for the limit of the geometrically weighted mean evolution of the process.


title: The Euler Class from a General Connection, Relative to a Metric

abstract: We extend the well-known formula for the Euler class of a real oriented even-dimensional vector bundle in terms of the curvature of a metric connection to the case of a general linear connection provided a metric is present. We rewrite the classical Gauss-Bonnet theorem in dimension two in light of this formula. We also discuss a potential application to a conjecture of Chern, and make a brief digression to discuss $m$-quasi-Einstein manifolds.


title: The relevance of pion-exchange contributions versus contact terms in the chiral effective field theory description of nucleon-nucleon scattering

abstract: The standard way to demonstrate the relevance of chiral symmetry for the NN interaction is to consider higher partial waves of NN scattering which are controlled entirely by chiral pion-exchanges (since contacts vanish). However, in applications of NN-potentials to nuclear structure and reactions, the lower partial waves are the important ones, making the largest contributions. Lower partial waves are sensitive to the short-range potential, and so, when the short-range contacts were to dominate over the chiral pion-contributions in lower partial waves, then the predictions from "chiral potentials" would have little to do with chiral symmetry. To address this issue, we investigate systematically the role of the (chiral) one- and two-pion exchanges, on the one hand, and the effect of the contacts, on the other hand, in the lower partial waves of NN scattering. We are able to clearly identify the signature of chiral symmetry in lower partial waves. Our study has also a pedagogical spin-off as it demonstrates in detail how the reproduction of the lower partial-wave phase shifts comes about from the various ingredients of the theory.


title: Local rules for fabricating allosteric networks

abstract: Mechanical properties of disordered networks can be significantly tailored by modifying a small fraction of their bonds. This procedure has been used to design and build mechanical metamaterials with a variety of responses. A long-range 'allosteric' response, where a localized input strain at one site gives rise to a localized output strain at a distant site, has been of particular interest. This work presents a novel approach to incorporating allosteric responses in experimental systems by pruning disordered networks $\textit{in-situ}$. Previous work has relied on computer simulations to design and predict the response of such systems using a cost function where the response of the entire network to each bond removal is used at each step to determine which bond to prune. It is not feasible to follow such a design protocol in experiments where one has access only to local response at each site. This paper presents design algorithms that allow determination of what bonds to prune based purely on the local stresses in the network without employing a cost function; using only local information, allosteric networks are designed in simulations and then built out of real materials. The results show that some pruning strategies work better than others when translated into an experimental system. A method is presented to measure local stresses experimentally in disordered networks. This approach is then used to implement pruning methods to design desired responses $\textit{in-situ}$. Results from these experiments confirm that the pruning methods are robust and work in a real laboratory material.


title: Comparative analysis for meaningful interpretation of rare-earth oxide M$_{4,5}$ energy loss edges

abstract: The magnetic, electronic, and optical properties of rare earth-oxides are directly influenced by the valency of the metallic cation. With the development of next generation electron energy-loss spectrometers, high-energy lanthanide fine structure can be studied with improved signal-to-noise for quantitative analysis. Unfortunately, the behavior of rare-earth $4f$ orbital electrons is not well understood. To establish best practices for analysis of energy-loss spectra from lanthanide oxides, we have performed a comparative study of the four traditional white line analysis methods extended to lanthanide $M_{4,5}$ edges resulting from $3d \rightarrow 4f$ orbital transitions using data from Gatan's EELS Atlas. The ${M_4}/{M_5}$ spectral feature ratios were examined as a function of $4f$ occupancy. The ${M_4}/{M_5}$ spectral feature ratio decreases exponentially as $4f$ occupancy increases, except for a plateau between S$\text{m}^{3+}$ and D$\text{y}^{3+}$. The full-width at half the maximum intensity of the $M_4$ edges shows increased broadening for S$\text{m}^{3+}$ through D$\text{y}^{3+}$. We suggest that the plateau results from $4f$ orbital half-filling and is explained through the relationship between electron transition probability and transition lifetime as expressed through Fermi's Golden Rule. Of the four spectral analysis methods described, only the integrated area method can be ascribed a quantitative physical interpretation.


title: An embedded multichannel sound acquisition system for drone audition

abstract: Microphone array techniques can improve the acoustic sensing performance on drones, compared to the use of a single microphone. However, multichannel sound acquisition systems are not available in current commercial drone platforms. To encourage the research in drone audition, we present an embedded sound acquisition and recording system with eight microphones and a multichannel sound recorder mounted on a quadcopter. In addition to recording and storing locally the sound from multiple microphones simultaneously, the embedded system can connect wirelessly to a remote terminal to transfer audio files for further processing. This will be the first stage towards creating a fully embedded solution for drone audition. We present experimental results obtained by state-of-the-art drone audition algorithms applied to the sound recorded by the embedded system.


title: IRS-Enabled Beam-Space Channel

abstract: The intelligent reflecting surface (IRS) is emphasized as a controlled scattering cluster. To this end, scatterers and traveling paths of multipath components are classified to build a new channel model. Unlike the conventional modeling, where the channels between system units are modeled independently, the new model considers the channel as a whole and decomposes it based on the traveling paths. The model shows clearly how IRS, in the beam-space context, converts the channel from a problem into a design element. After investigating IRS as a scattering cluster, based on a proposed segmentation scheme, the beamforming problem is considered with a focus on first-order reflections. Passive beamforming at IRS is shown to have two tiers; at the scatterer and antenna levels. A segment-activation scheme is proposed to maximize the received signal power, where the number of transmitting antenna elements to be used is given as a function of IRS positioning and beamforming at the receiver. The results show that while using more transmitting antenna elements to get narrower beams is possible, using fewer elements can give better performance, especially for larger IRS at close distances. The developed model also proves useful in addressing emerging issues in massive MIMO communication, namely, stationarity and spherical wavefronts.


title: Virtually unipotent curves in some non-NPC graph manifolds

abstract: Let $M$ be a graph manifold containing a single JSJ torus $T$ and whose JSJ blocks are of the form $\Sigma \times S^1$, where $\Sigma$ is a compact orientable surface with boundary. We show that if $M$ does not admit a Riemannian metric of everywhere nonpositive sectional curvature, then there is an essential curve on $T$ such that any finite-dimensional linear representation of $\pi_1(M)$ maps an element representing that curve to a matrix all of whose eigenvalues are roots of $1$. In particular, this shows that $\pi_1(M)$ does not admit a faithful finite-dimensional unitary representation, and gives a new proof that $\pi_1(M)$ is not linear over any field of positive characteristic.


title: MPC-MPNet: Model-Predictive Motion Planning Networks for Fast, Near-Optimal Planning under Kinodynamic Constraints

abstract: Kinodynamic Motion Planning (KMP) is to find a robot motion subject to concurrent kinematics and dynamics constraints. To date, quite a few methods solve KMP problems and those that exist struggle to find near-optimal solutions and exhibit high computational complexity as the planning space dimensionality increases. To address these challenges, we present a scalable, imitation learning-based, Model-Predictive Motion Planning Networks framework that quickly finds near-optimal path solutions with worst-case theoretical guarantees under kinodynamic constraints for practical underactuated systems. Our framework introduces two algorithms built on a neural generator, discriminator, and a parallelizable Model Predictive Controller (MPC). The generator outputs various informed states towards the given target, and the discriminator selects the best possible subset from them for the extension. The MPC locally connects the selected informed states while satisfying the given constraints leading to feasible, near-optimal solutions. We evaluate our algorithms on a range of cluttered, kinodynamically constrained, and underactuated planning problems with results indicating significant improvements in computation times, path qualities, and success rates over existing methods.


title: Robust Energy-Efficient Resource Management, SIC Ordering, and Beamforming Design for MC MISO-NOMA Enabled 6G

abstract: This paper studies a novel approach for successive interference cancellation (SIC) ordering and beamforming in a multiple antennas non-orthogonal multiple access (NOMA) network with multi-carrier multi-user setup. To this end, we formulate a joint beamforming design, subcarrier allocation, user association, and SIC ordering algorithm to maximize the worst-case energy efficiency (EE). The formulated problem is a non-convex mixed integer non-linear programming (MINLP) which is generally difficult to solve. To handle it, we first adopt the linearizion technique as well as relaxing the integer variables, and then we employ the Dinkelbach algorithm to convert it into a more mathematically tractable form. The adopted non-convex optimization problem is transformed into an equivalent rank-constrained semidefinite programming (SDP) and is solved by SDP relaxation and exploiting sequential fractional programming. Furthermore, to strike a balance between complexity and performance, a low complex approach based on alternative optimization is adopted. Numerical results unveil that the proposed SIC ordering method outperforms the conventional existing works addressed in the literature.


title: Heterogeneous Similarity Graph Neural Network on Electronic Health Records

abstract: Mining Electronic Health Records (EHRs) becomes a promising topic because of the rich information they contain. By learning from EHRs, machine learning models can be built to help human experts to make medical decisions and thus improve healthcare quality. Recently, many models based on sequential or graph models are proposed to achieve this goal. EHRs contain multiple entities and relations and can be viewed as a heterogeneous graph. However, previous studies ignore the heterogeneity in EHRs. On the other hand, current heterogeneous graph neural networks cannot be simply used on an EHR graph because of the existence of hub nodes in it. To address this issue, we propose Heterogeneous Similarity Graph Neural Network (HSGNN) analyze EHRs with a novel heterogeneous GNN. Our framework consists of two parts: one is a preprocessing method and the other is an end-to-end GNN. The preprocessing method normalizes edges and splits the EHR graph into multiple homogeneous graphs while each homogeneous graph contains partial information of the original EHR graph. The GNN takes all homogeneous graphs as input and fuses all of them into one graph to make a prediction. Experimental results show that HSGNN outperforms other baselines in the diagnosis prediction task.


title: Real-Time LSM-Trees for HTAP Workloads

abstract: Real-time analytics systems employ hybrid data layouts in which data are stored in different formats throughout their lifecycle. Recent data are stored in a row-oriented format to serve OLTP workloads and support high insert rates, while older data are transformed to a column-oriented format for OLAP access patterns. We observe that a Log-Structured Merge (LSM) Tree is a natural fit for a lifecycle-aware storage engine due to its high write throughput and level-oriented structure, in which records propagate from one level to the next over time. To build a lifecycle-aware storage engine using an LSM-Tree, we make a crucial modification to allow different data layouts in different levels, ranging from purely row-oriented to purely column-oriented, leading to a Real-Time LSM-Tree. We give a cost model and an algorithm to design a Real-Time LSM-Tree that is suitable for a given workload, followed by an experimental evaluation of LASER - a prototype implementation of our idea built on top of the RocksDB key-value store.


title: Measure-conditional Discriminator with Stationary Optimum for GANs and Statistical Distance Surrogates

abstract: We propose a simple but effective modification of the discriminators, namely measure-conditional discriminators, as a plug-and-play module for different GANs. By taking the generated distributions as part of input so that the target optimum for the discriminator is stationary, the proposed discriminator is more robust than the vanilla one. A variant of the measure-conditional discriminator can also handle multiple target distributions, or act as a surrogate model of statistical distances such as KL divergence with applications to transfer learning.


title: Narration Generation for Cartoon Videos

abstract: Research on text generation from multimodal inputs has largely focused on static images, and less on video data. In this paper, we propose a new task, narration generation, that is complementing videos with narration texts that are to be interjected in several places. The narrations are part of the video and contribute to the storyline unfolding in it. Moreover, they are context-informed, since they include information appropriate for the timeframe of video they cover, and also, do not need to include every detail shown in input scenes, as a caption would. We collect a new dataset from the animated television series Peppa Pig. Furthermore, we formalize the task of narration generation as including two separate tasks, timing and content generation, and present a set of models on the new task.


title: What Makes Good In-Context Examples for GPT-$3$?

abstract: GPT-$3$ has attracted lots of attention due to its superior performance across a wide range of NLP tasks, especially with its powerful and versatile in-context few-shot learning ability. Despite its success, we found that the empirical results of GPT-$3$ depend heavily on the choice of in-context examples. In this work, we investigate whether there are more effective strategies for judiciously selecting in-context examples (relative to random sampling) that better leverage GPT-$3$'s few-shot capabilities. Inspired by the recent success of leveraging a retrieval module to augment large-scale neural network models, we propose to retrieve examples that are semantically-similar to a test sample to formulate its corresponding prompt. Intuitively, the in-context examples selected with such a strategy may serve as more informative inputs to unleash GPT-$3$'s extensive knowledge. We evaluate the proposed approach on several natural language understanding and generation benchmarks, where the retrieval-based prompt selection approach consistently outperforms the random baseline. Moreover, it is observed that the sentence encoders fine-tuned on task-related datasets yield even more helpful retrieval results. Notably, significant gains are observed on tasks such as table-to-text generation (41.9% on the ToTTo dataset) and open-domain question answering (45.5% on the NQ dataset). We hope our investigation could help understand the behaviors of GPT-$3$ and large-scale pre-trained LMs in general and enhance their few-shot capabilities.


title: Decomposition of Bilateral Trade Flows Using a Three-Dimensional Panel Data Model

abstract: This study decomposes the bilateral trade flows using a three-dimensional panel data model. Under the scenario that all three dimensions diverge to infinity, we propose an estimation approach to identify the number of global shocks and country-specific shocks sequentially, and establish the asymptotic theories accordingly. From the practical point of view, being able to separate the pervasive and nonpervasive shocks in a multi-dimensional panel data is crucial for a range of applications, such as, international financial linkages, migration flows, etc. In the numerical studies, we first conduct intensive simulations to examine the theoretical findings, and then use the proposed approach to investigate the international trade flows from two major trading groups (APEC and EU) over 1982-2019, and quantify the network of bilateral trade.


title: MP3: A Unified Model to Map, Perceive, Predict and Plan

abstract: High-definition maps (HD maps) are a key component of most modern self-driving systems due to their valuable semantic and geometric information. Unfortunately, building HD maps has proven hard to scale due to their cost as well as the requirements they impose in the localization system that has to work everywhere with centimeter-level accuracy. Being able to drive without an HD map would be very beneficial to scale self-driving solutions as well as to increase the failure tolerance of existing ones (e.g., if localization fails or the map is not up-to-date). Towards this goal, we propose MP3, an end-to-end approach to mapless driving where the input is raw sensor data and a high-level command (e.g., turn left at the intersection). MP3 predicts intermediate representations in the form of an online map and the current and future state of dynamic agents, and exploits them in a novel neural motion planner to make interpretable decisions taking into account uncertainty. We show that our approach is significantly safer, more comfortable, and can follow commands better than the baselines in challenging long-term closed-loop simulations, as well as when compared to an expert driver in a large-scale real-world dataset.


title: Stratified flow past a sphere at moderate Reynolds numbers

abstract: A numerical study of stably stratified flows past spheres at Reynolds numbers $Re=200$ and $Re=300$ is reported. In these flow regimes, a neutrally stratified laminar flow induces distinctly different near-wake features. However, the flow behaviour changes significantly as the stratification increases and suppresses the scale of vertical displacements of fluid parcels. Computations for a range of Froude numbers $Fr\in [0.1,\infty]$ show that as Froude number decreases, the flow patterns for both Reynolds numbers become similar. The representative simulations of the lee-wave instability at $Fr=0.625$ and the two-dimensional vortex shedding at $Fr=0.25$ regimes are illustrated for flows past single and tandem spheres, thereby providing further insight into the dynamics of stratified flows past bluff bodies. In particular, the reported study examines the relative influence of viscosity and stratification on the dividing streamline elevation, wake structure and flow separation. The solutions of the Navier-Stokes equations in the incompressible Boussinesq limit are obtained on unstructured meshes suitable for simulations involving multiple bodies. Computations are accomplished using the finite volume, non-oscillatory forward-in-time (NFT) Multidimensional Positive Definite Transport Algorithm (MPDATA) based solver. The impact and validity of the numerical approximations, especially for the cases exhibiting strong stratification, are also discussed. Qualitative and quantitative comparisons with available laboratory experiments and prior numerical studies confirm the validity of the numerical approach.


title: TREGO: a Trust-Region Framework for Efficient Global Optimization

abstract: Efficient Global Optimization (EGO) is the canonical form of Bayesian optimization that has been successfully applied to solve global optimization of expensive-to-evaluate black-box problems. However, EGO struggles to scale with dimension, and offers limited theoretical guarantees. In this work, a trust-region framework for EGO (TREGO) is proposed and analyzed. TREGO alternates between regular EGO steps and local steps within a trust region. By following a classical scheme for the trust region (based on a sufficient decrease condition), the proposed algorithm enjoys global convergence properties, while departing from EGO only for a subset of optimization steps. Using extensive numerical experiments based on the well-known COCO {bound constrained problems}, we first analyze the sensitivity of TREGO to its own parameters, then show that the resulting algorithm is consistently outperforming EGO and getting competitive with other state-of-the-art black-box optimization methods.


title: Metachronal waves in concentrations of swimming Turbatrix aceti nematodes and an oscillator chain model for their coordinated motions

abstract: At high concentration, free swimming nematodes known as vinegar eels ({\it Turbatrix aceti}), collectively exhibit metachronal waves near a boundary. We find that the frequency of the collective traveling wave is lower than that of the freely swimming organisms. We explore models based on a chain of oscillators with nearest neighbor interactions that inhibit oscillator phase velocity. The phase of each oscillator represents the phase of the motion of the eel's head back and forth about its mean position. A strongly interacting directed chain model mimicking steric repulsion between organisms robustly gives traveling wave states and can approximately match the observed wavelength and oscillation frequency of the observed traveling wave. We predict body shapes assuming that waves propagate down the eel body at a constant speed. The phase oscillator model that impedes eel head overlaps also reduces close interactions throughout the eel bodies.


title: Classification of $K$-type formulas for the Heisenberg ultrahyperbolic operator $\square_s$ for $\widetilde{SL}(3,\mathbb{R})$ and tridiagonal determinants for local Heun functions

abstract: The $K$-type formulas of the space of $K$-finite solutions to the Heisenberg ultrahyperbolic equation $\square_sf=0$ for the non-linear group $\widetilde{SL}(3,\mathbb{R})$ are classified. This completes a previous study of Kable for the linear group $SL(m,\mathbb{R})$ in the case of $m=3$, as well as generalizes our earlier results on a certain second order differential operator. As a by-product we also show several properties of certain sequences $\{P_j(x;y)\}_{j=0}^\infty$ and $\{Q_j(x;y)\}_{j=0}^\infty$ of tridiagonal determinants, whose generating functions are given by local Heun functions. In particular, it is shown that these sequences satisfy a certain arithmetic-combinatorial property, which we refer to as a palindromic property. We further show that classical sequences of Cayley continuants $\{\mathrm{Cay}_j(x;y)\}_{j=0}^\infty$ and Krawtchouk polynomials $\{\mathcal{K}_j(x;y)\}_{j=0}^\infty$ also admit this property. In the end a new proof of Sylvester's formula for certain tridiagonal determinant $\mathrm{Sylv}(x;n)$ is provided from a representation theory point of view.


title: Optimal Pre-Processing to Achieve Fairness and Its Relationship with Total Variation Barycenter

abstract: We use disparate impact, i.e., the extent that the probability of observing an output depends on protected attributes such as race and gender, to measure fairness. We prove that disparate impact is upper bounded by the total variation distance between the distribution of the inputs given the protected attributes. We then use pre-processing, also known as data repair, to enforce fairness. We show that utility degradation, i.e., the extent that the success of a forecasting model changes by pre-processing the data, is upper bounded by the total variation distance between the distribution of the data before and after pre-processing. Hence, the problem of finding the optimal pre-processing regiment for enforcing fairness can be cast as minimizing total variations distance between the distribution of the data before and after pre-processing subject to a constraint on the total variation distance between the distribution of the inputs given protected attributes. This problem is a linear program that can be efficiently solved. We show that this problem is intimately related to finding the barycenter (i.e., center of mass) of two distributions when distances in the probability space are measured by total variation distance. We also investigate the effect of differential privacy on fairness using the proposed the total variation distances. We demonstrate the results using numerical experimentation with a practice dataset.


title: The Witten index and the spectral shift function

abstract: In \cite{APSIII} Atiyah, Patodi and Singer introduced spectral flow for elliptic operators on odd dimensional compact manifolds. They argued that it could be computed from the Fredholm index of an elliptic operator on a manifold of one higher dimension. A general proof of this fact was produced by Robbin-Salamon \cite{RS95}. In \cite{GLMST}, a start was made on extending these ideas to operators with some essential spectrum as occurs on non-compact manifolds. The new ingredient introduced there was to exploit scattering theory following the fundamental paper \cite{Pu08}. These results do not apply to differential operators directly, only to pseudo-differential operators on manifolds, due to the restrictive assumption that spectral flow is considered between an operator and {its perturbation by a relatively trace-class operator}. In this paper we extend the main results of these earlier papers to spectral flow between an operator and a perturbation satisfying a higher $p^{th}$ Schatten class condition for $0\leq p<\infty$, thus allowing differential operators on manifolds of any dimension $d<p+1$. In fact our main result does not assume any ellipticity or Fredholm properties at all and proves an operator theoretic trace formula motivated by \cite{BCPRSW, CGK16}. We illustrate our results using Dirac type operators on $L^2(\bbR^d)$ for arbitrary $d\in\bbN$. In this setting our main result substantially extends \cite[Theorem 3.5]{CGGLPSZ16}, where the case $d=1$ was treated.


title: Fast and accurate learned multiresolution dynamical downscaling for precipitation

abstract: This study develops a neural network-based approach for emulating high-resolution modeled precipitation data with comparable statistical properties but at greatly reduced computational cost. The key idea is to use combination of low- and high- resolution simulations to train a neural network to map from the former to the latter. Specifically, we define two types of CNNs, one that stacks variables directly and one that encodes each variable before stacking, and we train each CNN type both with a conventional loss function, such as mean square error (MSE), and with a conditional generative adversarial network (CGAN), for a total of four CNN variants. We compare the four new CNN-derived high-resolution precipitation results with precipitation generated from original high resolution simulations, a bilinear interpolater and the state-of-the-art CNN-based super-resolution (SR) technique. Results show that the SR technique produces results similar to those of the bilinear interpolator with smoother spatial and temporal distributions and smaller data variabilities and extremes than the original high resolution simulations. While the new CNNs trained by MSE generate better results over some regions than the interpolator and SR technique do, their predictions are still not as close as the original high resolution simulations. The CNNs trained by CGAN generate more realistic and physically reasonable results, better capturing not only data variability in time and space but also extremes such as intense and long-lasting storms. The new proposed CNN-based downscaling approach can downscale precipitation from 50~km to 12~km in 14~min for 30~years once the network is trained (training takes 4~hours using 1~GPU), while the conventional dynamical downscaling would take 1~month using 600 CPU cores to generate simulations at the resolution of 12~km over contiguous United States.


title: A new approach to the thermodynamic analysis of gas power cycles

abstract: Engineering Thermodynamics has been the core course of many science and engineering majors around the world, including energy and power, mechanical engineering, civil engineering, aerospace, cryogenic refrigeration, food engineering, chemical engineering, and environmental engineering, among which gas power cycle is one of the important contents. However, many Engineering Thermodynamics textbooks focus only on evaluating the thermal efficiency of gas power cycle, while the important concept of specific cycle work is ignored. Based on the generalized temperature-entropy diagram for the gas power cycles proposed by the authors, an ideal Otto cycle and an ideal Miller-Diesel cycle are taking as examples for the thermodynamic analyses of gas power cycles. The optimum compression ratio (or the pressure ratio) for the maximum specific cycle work or the maximum mean effective pressure is analyzed and determined. The ideal Otto and the ideal Miller-Diesel cycles, and also other gas power cycles for movable applications, are concluded that the operation under the maximum specific cycle work or the maximum mean effective pressure, instead of under the higher efficiency, is more economic and more reasonable. We concluded that the very important concept, i.e., the optimum compression (or pressure) ratio for the gas power cycles, should be emphasized in the Engineering Thermodynamics teaching process and in the latter revised or the newly edited textbooks, in order to better guide the engineering applications.


title: Design and characterization of a low-vibration laboratory with cylindrical inertia block geometry

abstract: Many modern nanofabrication and imaging techniques require an ultra-quiet environment to reach optimal resolution. Isolation from ambient vibrations is often achieved by placing the sensitive instrument atop a massive block that floats on air springs and is surrounded by acoustic barriers. Because typical building noise drops off above 120 Hz, it is advantageous to raise the flexural resonance frequencies of the inertia block and instrument far above 120 Hz. However, it can be challenging to obtain a high fundamental frequency of the floating block using a simple rectangular design. Here we design, construct, and characterize a vibration isolation system with a cylindrical inertia block, whose lowest resonance frequency of 249 Hz shows good agreement between finite element analysis simulation and directly measured modes. Our simulations show that a cylindrical design can achieve higher fundamental resonance frequency than a rectangular design of the same mass.


title: Sparse Array Beamformer Design for Active and Passive Sensing

abstract: Sparse sensor placement, with various design objectives, has successfully been employed in diverse application areas, particularly for enhanced parameter estimation and receiver performance. The sparse array design criteria are generally categorized into environment-independent and environment-dependent performance metrics. The former are largely benign to the underlying environment and, in principle, seek to maximize the spatial degrees of freedom by extending the coarray aperture. Environment-dependent objectives, on the other hand, consider the operating conditions characterized by emitters and targets in the array field of view, in addition to receiver noise. In this regard, applying such objectives renders the array configuration as well as the array weights time-varying in response to dynamic and changing environment. This work is geared towards designing environment-dependent sparse array beamformer to improve the output signal-to-interference and noise ratio using both narrowband and wideband signal platforms. One key challenge in implementing the data-dependent approaches is the lack of knowledge of exact or estimated values of the data autocorrelation function across the full sparse array aperture. At the core of this work is to address the aforementioned issues by devising innovative solutions using convex optimization and machine learning tools, structured sparsity concepts, low rank matrix completion schemes and fusing the environment-dependent and environment-independent deigns by developing a hybrid approach.


title: Quantum traces for $\mathrm{SL}_n(\mathbb{C})$: The case $n=3$

abstract: We generalize Bonahon-Wong's $\mathrm{SL}_2(\mathbb{C})$-quantum trace map to the setting of $\mathrm{SL}_3(\mathbb{C})$. More precisely, given a non-zero complex parameter $q=e^{2 \pi i \hbar}$, we associate to each isotopy class of framed oriented links $K$ in a thickened punctured surface $\mathfrak{S} \times (0, 1)$ a Laurent polynomial $\mathrm{Tr}_\lambda^q(K) = \mathrm{Tr}_\lambda^q(K)(X_i^q)$ in $q$-deformations $X_i^q$ of the Fock-Goncharov $\mathcal{X}$-coordinates for higher Teichm\"{u}ller space. This construction depends on a choice $\lambda$ of ideal triangulation of the surface $\mathfrak{S}$. Along the way, we propose a definition for a $\mathrm{SL}_n(\mathbb{C})$-version of this invariant.


title: Approximating monomials using Chebyshev polynomials

abstract: This paper considers the approximation of a monomial $x^n$ over the interval $[-1,1]$ by a lower-degree polynomial. This polynomial approximation can be easily computed analytically and is obtained by truncating the analytical Chebyshev series expansion of $x^n$. The error in the polynomial approximation in the supremum norm has an exact expression with an interesting probabilistic interpretation. We use this interpretation along with concentration inequalities to develop a useful upper bound for the error.


title: Primitive Chain Network Simulations of Entangled Melts of Symmetric and Asymmetric Star Polymers in Uniaxial Elongational Flows

abstract: Ianniruberto and Marrucci developed a theory whereby entangled branched polymers behave like linear ones in fast elongational flows. In order to test such prediction, Huang et al. performed elongational measurements on star polymer melts, indeed revealing that, in fast flows, the elongational viscosity is insensitive to the molecular structure, provided the molecular weight of the backbone is the same. Inspired by these studies, we here report on results obtained with multi-chain slip-link simulations for symmetric and asymmetric star polymer melts, as well as calculations of the Rouse time of the examined branched structures. The simulations semi-quantitatively reproduce the experimental data if the Kuhn-segment orientation-induced reduction of friction (SORF) is accounted for. The observed insensitivity of the nonlinear elongational viscosity to the molecular structure for the same span molar mass may be due to several factors. In the symmetric case, the calculated Rouse time of the star marginally differs from that of the linear molecule, so that possible differences in the observed stress fall within the experimental uncertainty. Secondly, it is possible that the flow-induced formation of hooked star pairs makes the effective Rouse time of the aggregate even closer to that of the linear polymer because the friction center moves towards the branchpoint of the star molecule. In the asymmetric case, it is shown that the stress contributed by the short arms is negligible with respect to that of the long ones. However, such stress-reduction is balanced by a dilution effect whereby the unstretched arms reduce SORF as they decrease the Kuhn-segment order parameter of the system. As a result of that dilution, the stress contributed by the backbone is larger. The two effects compensate one another so that the overall stress is virtually the same as the other architectures.


title: Chaotic-to-Fine Clustering for Unlabeled Plant Disease Images

abstract: Current annotation for plant disease images depends on manual sorting and handcrafted features by agricultural experts, which is time-consuming and labour-intensive. In this paper, we propose a self-supervised clustering framework for grouping plant disease images based on the vulnerability of Kernel K-means. The main idea is to establish a cross iterative under-clustering algorithm based on Kernel K-means to produce the pseudo-labeled training set and a chaotic cluster to be further classified by a deep learning module. In order to verify the effectiveness of our proposed framework, we conduct extensive experiments on three different plant disease datatsets with five plants and 17 plant diseases. The experimental results show the high superiority of our method to do image-based plant disease classification over balanced and unbalanced datasets by comparing with five state-of-the-art existing works in terms of different metrics.


title: ExpFinder: An Ensemble Expert Finding Model Integrating $N$-gram Vector Space Model and $\mu$CO-HITS

abstract: Finding an expert plays a crucial role in driving successful collaborations and speeding up high-quality research development and innovations. However, the rapid growth of scientific publications and digital expertise data makes identifying the right experts a challenging problem. Existing approaches for finding experts given a topic can be categorised into information retrieval techniques based on vector space models, document language models, and graph-based models. In this paper, we propose $\textit{ExpFinder}$, a new ensemble model for expert finding, that integrates a novel $N$-gram vector space model, denoted as $n$VSM, and a graph-based model, denoted as $\textit{$\mu$CO-HITS}$, that is a proposed variation of the CO-HITS algorithm. The key of $n$VSM is to exploit recent inverse document frequency weighting method for $N$-gram words and $\textit{ExpFinder}$ incorporates $n$VSM into $\textit{$\mu$CO-HITS}$ to achieve expert finding. We comprehensively evaluate $\textit{ExpFinder}$ on four different datasets from the academic domains in comparison with six different expert finding models. The evaluation results show that $\textit{ExpFinder}$ is a highly effective model for expert finding, substantially outperforming all the compared models in 19% to 160.2%.


title: Toeplitz algebras of semigroups

abstract: To each monoid $P$ that embeds in a group we associate a universal Toeplitz C*-algebra $T_u(P)$ defined via generators and relations; $T_u(P)$ is a quotient of Li's semigroup C*-algebra $C^*(P)$ and they are isomorphic if and only if $P$ satisfies independence. We give a partial crossed product realization of $T_u(P)$ and show that several key results known for $C^*(P)$ when $P$ satisfies independence are also valid for $T_u(P)$ when independence fails. At the level of the reduced semigroup C*-algebra $T_r(P)$, we show that nontrivial ideals have nontrivial intersection with the reduced crossed product of the diagonal subalgebra by the action of the group of units of $P$, generalizing a result of Li for monoids with trivial unit group. We also characterize when the action of the group of units is topologically free and we show that in this case a representation of $T_r(P)$ is faithful iff it is jointly proper. This yields a uniqueness theorem for C*-algebras generated by semigroups of isometries that unifies several classical results. We provide a presentation for the covariance algebra of the product system over $P$ with one-dimensional fibers in terms of a notion of foundation sets of constructible ideals that generalizes that of Sims and Yeend for quasi-lattice orders. The covariance algebra is a full, or universal, analogue of the boundary quotient. We give purely algebraic sufficient conditions on $P$ for the boundary quotient to be purely infinite simple, which reduce to Starling's conditions in the case of right LCM monoids. We discuss applications of our results to examples that include a numerical semigroup and the $ax+b$-monoid of an integral domain. This is particularly interesting in the case of nonmaximal orders in number fields, for which we show independence always fails. In addition, we simplify and generalize results for right LCM monoids.


title: Inference for BART with Multinomial Outcomes

abstract: The multinomial probit Bayesian additive regression trees (MPBART) framework was proposed by Kindo et al. (KD), approximating the latent utilities in the multinomial probit (MNP) model with BART (Chipman et al. 2010). Compared to multinomial logistic models, MNP does not assume independent alternatives and the correlation structure among alternatives can be specified through multivariate Gaussian distributed latent utilities. We introduce two new algorithms for fitting the MPBART and show that the theoretical mixing rates of our proposals are equal or superior to the existing algorithm in KD. Through simulations, we explore the robustness of the methods to the choice of reference level, imbalance in outcome frequencies, and the specifications of prior hyperparameters for the utility error term. The work is motivated by the application of generating posterior predictive distributions for mortality and engagement in care among HIV-positive patients based on electronic health records (EHRs) from the Academic Model Providing Access to Healthcare (AMPATH) in Kenya. In both the application and simulations, we observe better performance using our proposals as compared to KD in terms of MCMC convergence rate and posterior predictive accuracy.


title: A diffuse interface method for simulation-based screening of heat transfer processes with complex geometries

abstract: Frequently, the design of physicochemical processes requires screening of large numbers of alternative designs with complex geometries. These geometries may result in conformal meshes which introduce stability issues, significant computational complexity, and require user-interaction for their creation. In this work, a method for simulation of heat transfer using the diffuse interface method to capture complex geometry is presented as an alternative to a conformal meshing, with analysis and comparisons given. The methods presented include automated non-iterative generation of phase fields from CAD geometries and an extension of the diffuse interface method for mixed boundary conditions. Simple measures of diffuse interface quality are presented and found provide predictions of performance. The method is applied to a realistic heat transfer problem and compared to the traditional conformal mesh approach. It is found to enable reasonable accuracy at an order-of-magnitude reduction in simulation time or comparable accuracy for equivalent simulation times.


title: Counterexample-Guided Prophecy for Model Checking Modulo the Theory of Arrays

abstract: We develop a framework for model checking infinite-state systems by automatically augmenting them with auxiliary variables, enabling quantifier-free induction proofs for systems that would otherwise require quantified invariants. We combine this mechanism with a counterexample-guided abstraction refinement scheme for the theory of arrays. Our framework can thus, in many cases, reduce inductive reasoning with quantifiers and arrays to quantifier-free and array-free reasoning. We evaluate the approach on a wide set of benchmarks from the literature. The results show that our implementation often outperforms state-of-the-art tools, demonstrating its practical potential.


title: Crossover from lamellar to spongy ice morphologies within a single ice crystal during unidirectional freezing of an aqueous solution

abstract: Ice growth from liquid phase has been extensively investigated in various conditions, especially for ice freely grown in undercooled water and aqueous solutions. Although unidirectional ice growth plays a significant role in sea ice and freeze casting, the detailed pattern formation of unidirectionally grown ice in an aqueous solution remains elusive. For the first time, we in situ proved a crossover from lamellar to spongy ice morphologies of a single ice crystal via unidirectional freezing of an aqueous solution. The spongy ice morphology originates from the intersect of tilted lamellar ice and is observed in a single ice crystal, which is intrinsically different from the competitive growth of bi-crystal composed of two differently orientated grains in directional solidification. These results provide a complete physical picture of unidirectionally grown ice from aqueous solution and are believed to promote our understanding of various pattern of ice in many relevant domains where pattern formation of ice crystal is vital.


title: HyperNTF: A Hypergraph Regularized Nonnegative Tensor Factorization for Dimensionality Reduction

abstract: Tensor decomposition is an effective tool for learning multi-way structures and heterogeneous features from high-dimensional data, such as the multi-view images and multichannel electroencephalography (EEG) signals, are often represented by tensors. However, most of tensor decomposition methods are the linear feature extraction techniques, which are unable to reveal the nonlinear structure within high-dimensional data. To address such problem, a lot of algorithms have been proposed for simultaneously performs linear and non-linear feature extraction. A representative algorithm is the Graph Regularized Non-negative Matrix Factorization (GNMF) for image clustering. However, the normal 2-order graph can only models the pairwise similarity of objects, which cannot sufficiently exploit the complex structures of samples. Thus, we propose a novel method, named Hypergraph Regularized Non-negative Tensor Factorization (HyperNTF), which utilizes hypergraph to encode the complex connections among samples and employs the factor matrix corresponding with last mode of Canonical Polyadic (CP) decomposition as low-dimensional representation. Extensive experiments on synthetic manifolds, real-world image datasets, and EEG signals, demonstrating that HyperNTF outperforms the state-of-the-art methods in terms of dimensionality reduction, clustering, and classification.


title: System Identification near a Hopf Bifurcation via the Noise-Induced Dynamics in the Fixed-Point Regime

abstract: A Hopf bifurcation is prevalent in many nonlinear dynamical systems. When a system prior to a Hopf bifurcation is exposed to a sufficient level of noise, its noise-induced dynamics can provide valuable information about the impending bifurcation. In this thesis, we present a system identification (SI) framework that exploits the noise-induced dynamics prior to a Hopf bifurcation. The framework is novel in that it is capable of predicting the bifurcation point and the post-bifurcation dynamics using only pre-bifurcation data. Specifically, we present two different versions of the framework: input-output and output-only. For the input-output version, the system is forced with additive noise generated by an external actuator, and its response is measured. For the output-only version, the intrinsic noise of the system acts as the noise source and only the output signal is measured. In both versions, the Fokker-Planck equations, which describe the probability density function of the fluctuation amplitude, are derived from self-excited oscillator models. Then, the coefficients of these models are extracted from the experimental probability density functions characterizing the noise-induced response in the fixed-point regime. The SI framework is tested on three different experimental systems: a low-density jet, a flame-driven Rijke tube, and a gas-turbine combustor. For these systems, we demonstrate that the proposed framework can identify the nature of the Hopf bifurcation and the system's order of nonlinearity. Moreover, by extrapolating the identified model coefficients, we are able to forecast the locations of the bifurcation points and the limit-cycle features after those points. To the best of our knowledge, this is the first time that SI has been performed using data from only the pre-bifurcation regime, without the need for knowledge of the location of the bifurcation point.


title: Joint Energy-based Model Training for Better Calibrated Natural Language Understanding Models

abstract: In this work, we explore joint energy-based model (EBM) training during the finetuning of pretrained text encoders (e.g., Roberta) for natural language understanding (NLU) tasks. Our experiments show that EBM training can help the model reach a better calibration that is competitive to strong baselines, with little or no loss in accuracy. We discuss three variants of energy functions (namely scalar, hidden, and sharp-hidden) that can be defined on top of a text encoder, and compare them in experiments. Due to the discreteness of text data, we adopt noise contrastive estimation (NCE) to train the energy-based model. To make NCE training more effective, we train an auto-regressive noise model with the masked language model (MLM) objective.


title: Unusual Nonmagnetic Ordered State in CeCoSi Revealed by $^{59}$Co-NMR and NQR Measurements

abstract: We performed $^{59}$Co nuclear magnetic and quadrupole resonance (NMR and NQR) measurements under pressure on a single-crystalline CeCoSi, which undergoes an unresolved phase transition at $T_0$. The NQR spectra clearly showed that the phase transition at $T_0$ is nonmagnetic, but any symmetry lowering at the Co site was not seen irrespective of the feature of second-order phase transition. By contrast, the NMR spectra were split by the induced magnetic field perpendicular to the external magnetic field. These results show that the phase below $T_0$ is not a simple paramagnetic state but is most likely electric multipolar ordered state of Ce $4f$ electrons. The development of the Kondo effect by applying pressure is thought to be crucial to stabilize this state and to show novel features beyond commonality of tetragonal Ce-based systems.


title: Irreversibility, Loschmidt echo, and thermodynamic uncertainty relation

abstract: Entropy production characterizes irreversibility. This viewpoint allows us to consider the thermodynamic uncertainty relation, which states that a higher precision can be achieved at the cost of higher entropy production, as a relation between precision and irreversibility. Considering the original and perturbed dynamics, we show that the precision of an arbitrary counting observable in continuous measurement of quantum Markov processes is bounded from below by Loschmidt echo between the two dynamics, representing the irreversibility of quantum dynamics. When considering particular perturbed dynamics, our relation leads to several thermodynamic uncertainty relations, indicating that our relation provides a unified perspective on classical and quantum thermodynamic uncertainty relations.


title: Deep Structured Reactive Planning

abstract: An intelligent agent operating in the real-world must balance achieving its goal with maintaining the safety and comfort of not only itself, but also other participants within the surrounding scene. This requires jointly reasoning about the behavior of other actors while deciding its own actions as these two processes are inherently intertwined - a vehicle will yield to us if we decide to proceed first at the intersection but will proceed first if we decide to yield. However, this is not captured in most self-driving pipelines, where planning follows prediction. In this paper we propose a novel data-driven, reactive planning objective which allows a self-driving vehicle to jointly reason about its own plans as well as how other actors will react to them. We formulate the problem as an energy-based deep structured model that is learned from observational data and encodes both the planning and prediction problems. Through simulations based on both real-world driving and synthetically generated dense traffic, we demonstrate that our reactive model outperforms a non-reactive variant in successfully completing highly complex maneuvers (lane merges/turns in traffic) faster, without trading off collision rate.


title: Breaking the degeneracy between gas inflow and outflows with stellar metallicity: Insights on M101

abstract: An analytical chemical evolution model is constructed to investigate the radial distribution of gas-phase and stellar metallicity for star-forming galaxies. By means of the model, the gas-phase and stellar metallicity can be obtained from the stellar-to-gas mass ratio. Both the gas inflow and outflow processes play an important role in building the final gas-phase metallicity, and there exists degeneracy effect between the gas inflow and outflow rates for star-forming galaxies. On the other hand, stellar metallicity is more sensitive to the gas outflow rate than to the gas inflow rate, and this helps to break the parameter degeneracy for star-forming galaxies. We apply this analysis method to the nearby disc galaxy M\,101 and adopting the classical $\chi^{2}$ methodology to explore the influence of model parameters on the resulted metallicity. It can be found that the combination of gas-phase and stellar metallicity is indeed more effective for constraining the gas inflow and outflow rates. Our results also show that the model with relatively strong gas outflows but weak gas inflow describes the evolution of M\,101 reasonably well.


title: Towards a more sustainable academic publishing system

abstract: Communicating new scientific discoveries is key to human progress. Yet, this endeavor is hindered by monetary restrictions for publishing one's findings and accessing other scientists' reports. This process is further exacerbated by a large portion of publishing media owned by private, for-profit companies that do not reinject academic publishing benefits into the scientific community, in contrast with journals from scientific societies. As the academic world is not exempt from economic crises, new alternatives are necessary to support a fair publishing system for society. After summarizing the general issues of academic publishing today, we present several solutions at the levels of the individual scientist, the scientific community, and the publisher towards more sustainable scientific publishing. By providing a voice to the many scientists who are fundamental protagonists, yet often powerless witnesses, of the academic publishing system, and a roadmap for implementing solutions, this initiative can spark increased awareness and promote shifts towards impactful practices.


title: The Lerch's $\Phi$ Analytic Continuation

abstract: We demonstrate how to obtain the analytic continuation of formulae for the Lerch transcendent function, $\Phi(e^m,k,b)$, and the polylogarithm, $\mathrm{Li}_{k}(e^{m})$, that only hold at the positive integers. The result are alternative expressions for these functions and their partial sums valid in the complex half-plane, $\Re{(k)}>0$.


title: Minimal surfaces in $\mathbb{R}^4$ like the Lagrangian catenoid

abstract: In this paper, we discuss complete minimal immersions in $\mathbb{R}^N$($N\geq4$) with finite total curvature and embedded planar ends. First, we prove nonexistence for the following cases: (1) genus 1 with 2 embedded planar ends, (2) genus $\neq4$, hyperelliptic with 2 embedded planar ends like the Lagrangian catenoid. Then we show the existence of embedded minimal spheres in $\mathbb{R}^4$ with 3 embedded planar ends. Moreover, we construct genus $g$ examples in $\mathbb{R}^4$ with $d$ embedded planar ends such that $g\geq 1$ and $g+2\leq d\leq 2g+1$. These examples include a family of embedded minimal tori with 3 embedded planar ends.


title: Learning to Select for MIMO Radar based on Hybrid Analog-Digital Beamforming

abstract: In this paper, we propose an energy-efficient radar beampattern design framework for a Millimeter Wave (mmWave) massive multi-input multi-output (mMIMO) system, equipped with a hybrid analog-digital (HAD) beamforming structure. Aiming to reduce the power consumption and hardware cost of the mMIMO system, we employ a machine learning approach to synthesize the probing beampattern based on a small number of RF chains and antennas. By leveraging a combination of softmax neural networks, the proposed solution is able to achieve a desirable beampattern with high accuracy.


title: Minimal Schedule with Minimal Number of Agents in Attack-Defence Trees

abstract: Expressing attack-defence trees in a multi-agent setting allows for studying a new aspect of security scenarios, namely how the number of agents and their task assignment impact the performance, e.g. attack time, of strategies executed by opposing coalitions. Optimal scheduling of agents' actions, a non-trivial problem, is thus vital. We discuss associated caveats and propose an algorithm that synthesises such an assignment, targeting minimal attack time and using minimal number of agents for a given attack-defence tree.


title: Adaptive Change Point Monitoring for High-Dimensional Data

abstract: In this paper, we propose a class of monitoring statistics for a mean shift in a sequence of high-dimensional observations. Inspired by the recent U-statistic based retrospective tests developed by Wang et al.(2019) and Zhang et al.(2020), we advance the U-statistic based approach to the sequential monitoring problem by developing a new adaptive monitoring procedure that can detect both dense and sparse changes in real-time. Unlike Wang et al.(2019) and Zhang et al.(2020), where self-normalization was used in their tests, we instead introduce a class of estimators for $q$-norm of the covariance matrix and prove their ratio consistency. To facilitate fast computation, we further develop recursive algorithms to improve the computational efficiency of the monitoring procedure. The advantage of the proposed methodology is demonstrated via simulation studies and real data illustrations.


title: ZeRO-Offload: Democratizing Billion-Scale Model Training

abstract: Large-scale model training has been a playing ground for a limited few requiring complex model refactoring and access to prohibitively expensive GPU clusters. ZeRO-Offload changes the large model training landscape by making large model training accessible to nearly everyone. It can train models with over 13 billion parameters on a single GPU, a 10x increase in size compared to popular framework such as PyTorch, and it does so without requiring any model change from the data scientists or sacrificing computational efficiency. ZeRO-Offload enables large model training by offloading data and compute to CPU. To preserve compute efficiency, it is designed to minimize the data movement to/from GPU, and reduce CPU compute time while maximizing memory savings on GPU. As a result, ZeRO-Offload can achieve 40 TFlops/GPU on a single NVIDIA V100 GPU for 10B parameter model compared to 30TF using PyTorch alone for a 1.4B parameter model, the largest that can be trained without running out of memory. ZeRO-Offload is also designed to scale on multiple-GPUs when available, offering near linear speedup on up to 128 GPUs. Additionally, it can work together with model parallelism to train models with over 70 billion parameters on a single DGX-2 box, a 4.5x increase in model size compared to using model parallelism alone. By combining compute and memory efficiency with ease-of-use, ZeRO-Offload democratizes large-scale model training making it accessible to even data scientists with access to just a single GPU.


title: $C_2$-equivariant topological modular forms

abstract: We compute the homotopy groups of the $C_2$ fixed points of equivariant topological modular forms at the prime $2$ using the descent spectral sequence. We then show that as a $\mathrm{TMF}$-module, it is isomorphic to the tensor product of $\mathrm{TMF}$ with an explicit finite cell complex.


title: Hierarchical disentangled representation learning for singing voice conversion

abstract: Conventional singing voice conversion (SVC) methods often suffer from operating in high-resolution audio owing to a high dimensionality of data. In this paper, we propose a hierarchical representation learning that enables the learning of disentangled representations with multiple resolutions independently. With the learned disentangled representations, the proposed method progressively performs SVC from low to high resolutions. Experimental results show that the proposed method outperforms baselines that operate with a single resolution in terms of mean opinion score (MOS), similarity score, and pitch accuracy.


title: Resolution Limits of Non-Adaptive 20 Questions Search for Multiple Targets

abstract: We study the problem of simultaneous search for multiple targets over a multidimensional unit cube and derive fundamental resolution limits of non-adaptive querying procedures using the 20 questions estimation framework. The performance criterion that we consider is the achievable resolution, which is defined as the maximal $L_\infty$ norm between the location vector and its estimated version where the maximization is over all target location vectors. The fundamental resolution limit is defined as the minimal achievable resolution of any non-adaptive query procedure, where each query has binary yes/no answers. We drive non-asymptotic and second-order asymptotic bounds on the minimal achievable resolution, using tools from finite blocklength information theory. Specifically, in the achievability part, we relate the 20 questions problem to data transmission over a multiple access channel, use the information spectrum method by Han and borrow results from finite blocklength analysis for random access channel coding. In the converse part, we relate the 20 questions problem to data transmission over a point-to-point channel and adapt finite blocklength converse results for channel coding. Our results extend the purely first-order asymptotic analyses of Kaspi \emph{et al.} (ISIT 2015) for the one-dimensional case: we consider channels beyond the binary symmetric channel and derive non-asymptotic and second-order asymptotic bounds on the performance of optimal non-adaptive query procedures.


title: A photospheric and chromospheric activity analysis of the quiescent retrograde-planet host $\nu$ Octantis A

abstract: The single-lined spectroscopic binary $\nu$ Octantis provided evidence of the first conjectured circumstellar planet demanding an orbit retrograde to the stellar orbits. The planet-like behaviour is now based on 1437 radial velocities (RVs) acquired from 2001 to 2013. $\nu$ Oct's semimajor axis is only 2.6 AU with the candidate planet orbiting $\nu$ Oct A about midway between. These details seriously challenge our understanding of planet formation and our decisive modelling of orbit reconfiguration and stability scenarios. However, all non-planetary explanations are also inconsistent with numerous qualitative and quantitative tests including previous spectroscopic studies of bisectors and line-depth ratios, photometry from Hipparcos and the more recent space missions TESS and GAIA (whose increased parallax classifies $\nu$ Oct A closer still to a subgiant ~ K1 IV). We conducted the first large survey of $\nu$ Oct A's chromosphere: 198 Ca II H-line and 1160 H $\alpha$ indices using spectra from a previous RV campaign (2009-2013). We also acquired 135 spectra (2018-2020) primarily used for additional line-depth ratios, which are extremely sensitive to the photosphere's temperature. We found no significant RV-correlated variability. Our line-depth ratios indicate temperature variations of only $\pm$ 4 K, as achieved previously. Our atypical Ca II analysis models the indices in terms of S/N and includes covariance significantly in their errors. The H $\alpha$ indices have a quasi-periodic variability which we demonstrate is due to telluric lines. Our new evidence provides further multiple arguments realistically only in favor of the planet.


title: Performance Analysis and Codebook Design for mmWave Beamforming System with Beam Squint

abstract: Beamforming technology is widely used in millimeter wave systems to combat path losses, and beamformers are usually selected from a predefined codebook. Unfortunately, the traditional codebook design neglects the beam squint effect, and this will cause severe performance degradation when the bandwidth is large. In this letter, we consider that a codebook with fixed size is adopted in the wideband beamforming system. First, we analyze how beam squint affects system performance when all beams have the same width. The expression of average spectrum efficiency is derived based on the ideal beam pattern. Next, we formulate the optimization problem to design the optimal codebook. Simulation results demonstrate that the proposed codebook deals with beam squint by spreading the beam coverage and significantly mitigates the performance degradation.


title: Exponential Integration for Efficient and Accurate Multi-Body Simulation with Stiff Viscoelastic Contacts

abstract: The simulation of multi-body systems with frictional contacts is a fundamental tool for many fields, such as robotics, computer graphics, and mechanics. Hard frictional contacts are particularly troublesome to simulate because they make the differential equations stiff, calling for computationally demanding implicit integration schemes. We suggest to tackle this issue by using exponential integrators, a long-standing class of integration schemes (first introduced in the 60's) that in recent years has enjoyed a resurgence of interest. We show that this scheme can be easily applied to multi-body systems subject to stiff viscoelastic contacts, producing accurate results at lower computational cost than \changed{classic explicit or implicit schemes}. In our tests with quadruped and biped robots, our method demonstrated stable behaviors with large time steps (10 ms) and stiff contacts ($10^5$ N/m). Its excellent properties, especially for fast and coarse simulations, make it a valuable candidate for many applications in robotics, such as simulation, Model Predictive Control, Reinforcement Learning, and controller design.


title: On the Differentially Private Nature of Perturbed Gradient Descent

abstract: We consider the problem of empirical risk minimization given a database, using the gradient descent algorithm. We note that the function to be optimized may be non-convex, consisting of saddle points which impede the convergence of the algorithm. A perturbed gradient descent algorithm is typically employed to escape these saddle points. We show that this algorithm, that perturbs the gradient, inherently preserves the privacy of the data. We then employ the differential privacy framework to quantify the privacy hence achieved. We also analyze the change in privacy with varying parameters such as problem dimension and the distance between the databases.


title: Faster Convergence in Deep-Predictive-Coding Networks to Learn Deeper Representations

abstract: Deep-predictive-coding networks (DPCNs) are hierarchical, generative models. They rely on feed-forward and feed-back connections to modulate latent feature representations of stimuli in a dynamic and context-sensitive manner. A crucial element of DPCNs is a forward-backward inference procedure to uncover sparse, invariant features. However, this inference is a major computational bottleneck. It severely limits the network depth due to learning stagnation. Here, we prove why this bottleneck occurs. We then propose a new forward-inference strategy based on accelerated proximal gradients. This strategy has faster theoretical convergence guarantees than the one used for DPCNs. It overcomes learning stagnation. We also demonstrate that it permits constructing deep and wide predictive-coding networks. Such convolutional networks implement receptive fields that capture well the entire classes of objects on which the networks are trained. This improves the feature representations compared with our lab's previous non-convolutional and convolutional DPCNs. It yields unsupervised object recognition that surpass convolutional autoencoders and are on par with convolutional networks trained in a supervised manner.


title: CFC-Net: A Critical Feature Capturing Network for Arbitrary-Oriented Object Detection in Remote Sensing Images

abstract: Object detection in optical remote sensing images is an important and challenging task. In recent years, the methods based on convolutional neural networks have made good progress. However, due to the large variation in object scale, aspect ratio, and arbitrary orientation, the detection performance is difficult to be further improved. In this paper, we discuss the role of discriminative features in object detection, and then propose a Critical Feature Capturing Network (CFC-Net) to improve detection accuracy from three aspects: building powerful feature representation, refining preset anchors, and optimizing label assignment. Specifically, we first decouple the classification and regression features, and then construct robust critical features adapted to the respective tasks through the Polarization Attention Module (PAM). With the extracted discriminative regression features, the Rotation Anchor Refinement Module (R-ARM) performs localization refinement on preset horizontal anchors to obtain superior rotation anchors. Next, the Dynamic Anchor Learning (DAL) strategy is given to adaptively select high-quality anchors based on their ability to capture critical features. The proposed framework creates more powerful semantic representations for objects in remote sensing images and achieves high-performance real-time object detection. Experimental results on three remote sensing datasets including HRSC2016, DOTA, and UCAS-AOD show that our method achieves superior detection performance compared with many state-of-the-art approaches. Code and models are available at https://github.com/ming71/CFC-Net.


title: Stacked LSTM Based Deep Recurrent Neural Network with Kalman Smoothing for Blood Glucose Prediction

abstract: Blood glucose (BG) management is crucial for type-1 diabetes patients resulting in the necessity of reliable artificial pancreas or insulin infusion systems. In recent years, deep learning techniques have been utilized for a more accurate BG level prediction system. However, continuous glucose monitoring (CGM) readings are susceptible to sensor errors. As a result, inaccurate CGM readings would affect BG prediction and make it unreliable, even if the most optimal machine learning model is used. In this work, we propose a novel approach to predicting blood glucose level with a stacked Long short-term memory (LSTM) based deep recurrent neural network (RNN) model considering sensor fault. We use the Kalman smoothing technique for the correction of the inaccurate CGM readings due to sensor error. For the OhioT1DM dataset, containing eight weeks' data from six different patients, we achieve an average RMSE of 6.45 and 17.24 mg/dl for 30 minutes and 60 minutes of prediction horizon (PH), respectively. To the best of our knowledge, this is the leading average prediction accuracy for the ohioT1DM dataset. Different physiological information, e.g., Kalman smoothed CGM data, carbohydrates from the meal, bolus insulin, and cumulative step counts in a fixed time interval, are crafted to represent meaningful features used as input to the model. The goal of our approach is to lower the difference between the predicted CGM values and the fingerstick blood glucose readings - the ground truth. Our results indicate that the proposed approach is feasible for more reliable BG forecasting that might improve the performance of the artificial pancreas and insulin infusion system for T1D diabetes management.


title: Subregular $J$-rings of Coxeter systems via quiver path algebras

abstract: We study the subregular $J$-ring $J_C$ of a Coxeter system $(W,S)$, a subring of Lusztig's $J$-ring. We prove that $J_C$ is isomorphic to a quotient of the path algebra of the double quiver of $(W,S)$ by a suitable ideal that we associate to a family of Chebyshev polynomials. As applications, we use quiver representations to study the category mod-$A_K$ of finite dimensional right modules of the algebra $A_K=K\otimes_\Z J_C$ over an algebraically closed field $K$ of characteristic zero. Our results include classifications of Coxeter systems for which mod-$A_K$ is semisimple, has finitely many simple modules up to isomorphism, or has a bound on the dimensions of simple modules. Incidentally, we show that every group algebra of a free product of finite cyclic groups is Morita equivalent to the algebra $A_K$ for a suitable Coxeter system; this allows us to specialize the classifications to the module categories of such group algebras.


title: High order efficient algorithm for computation of MHD flow ensembles

abstract: In this paper, we propose, analyze, and test a new fully discrete, efficient, decoupled, stable, and practically second-order time-stepping algorithm for computing MHD ensemble flow averages under uncertainties in the initial conditions and forcing. For each viscosity and magnetic diffusivity pair, the algorithm picks the largest possible parameter $\theta\in[0,1]$ to avoid the instability that arises due to the presence of some explicit viscous terms. At each time step, the algorithm shares the same system matrix with all $J$ realizations but with different right-hand-side vectors. That saves assembling time and computer memory, allows the reuse of the same preconditioner, and can take the advantage of block linear solvers. For the proposed algorithm, we prove stability and convergence rigorously. To illustrate the predicted convergence rates of our analysis, numerical experiments with manufactured solutions are given on a unit square domain. Finally, we test the scheme on a benchmark channel flow over a step problem and it performs well.


title: Deep Symmetric Adaptation Network for Cross-modality Medical Image Segmentation

abstract: Unsupervised domain adaptation (UDA) methods have shown their promising performance in the cross-modality medical image segmentation tasks. These typical methods usually utilize a translation network to transform images from the source domain to target domain or train the pixel-level classifier merely using translated source images and original target images. However, when there exists a large domain shift between source and target domains, we argue that this asymmetric structure could not fully eliminate the domain gap. In this paper, we present a novel deep symmetric architecture of UDA for medical image segmentation, which consists of a segmentation sub-network, and two symmetric source and target domain translation sub-networks. To be specific, based on two translation sub-networks, we introduce a bidirectional alignment scheme via a shared encoder and private decoders to simultaneously align features 1) from source to target domain and 2) from target to source domain, which helps effectively mitigate the discrepancy between domains. Furthermore, for the segmentation sub-network, we train a pixel-level classifier using not only original target images and translated source images, but also original source images and translated target images, which helps sufficiently leverage the semantic information from the images with different styles. Extensive experiments demonstrate that our method has remarkable advantages compared to the state-of-the-art methods in both cross-modality Cardiac and BraTS segmentation tasks.