title: Assessment of the regionalised demand response potential in Germany using an open source tool and dataset

abstract: With the expansion of renewable energies in Germany, imminent grid congestion events occur more often. One approach for avoiding curtailment of renewable energies is to cover excess feed-in by demand response. As curtailment is often a local phenomenon, in this work we determine the regional demand response potential for the 401 German administrative districts. The load regionalisation is based on weighting factors derived from population and employment statistics, locations of industrial facilities, etc. Using periodic and temperature-dependent load profiles and technology specific parameters, load shifting potentials were determined with a temporal resolution of 15 minutes. Our analysis yields that power-to-heat technologies provide the highest potentials, followed by residential appliances, commercial and industrial loads. For the considered 2030 scenario, power-to-gas and e-mobility also contribute a significant potential. The cumulated load increase potential of all technologies ranges from $5 - 470~MW$ per administrative district. The median value is $25~MW$, which would suffice to avoid the curtailment of 8 classical wind turbines. Further, we calculated load shifting cost-potential curves for each district. Industrial processes and power-to-heat in district heating have the lowest load shifting investment cost, due to the largest installed capacities per facility. We distinguished between different size classes of the installed capacity of heat pumps, yielding $23\%$ lower average investment cost for heat pump flexibilisation in the city of Berlin compared to a rural district. The variable costs of most considered load shifting technologies remain under the average compensation costs for curtailment of renewable energies of $110~\text{\euro{}}/MWh$. As all results and the developed code are published under open source licenses, they can be integrated into energy system models.


title: A Gaia Survey for Young Stars Associated with the Lupus Clouds

abstract: I have used high-precision photometry and astrometry from the second data release of the Gaia mission to perform a survey for young stars associated with the Lupus clouds, which have distances of ~160 pc and reside within the Sco-Cen OB association. The Gaia data have made it possible to distinguish Lupus members from most of the stars in other groups in Sco-Cen that overlap with the Lupus clouds, which have contaminated previous surveys. The new catalog of candidate Lupus members should be complete for spectral types earlier than M7 at A_K<0.2 within fields encompassing clouds 1--4. I have used that catalog to characterize various aspects of the Lupus stellar population. For instance, the sequence of low-mass stars in Lupus is ~0.4 mag brighter than the sequence for Upper Sco, which implies an age of ~6 Myr based an adopted age of 10-12 Myr for Upper Sco and the change in luminosity with age predicted by evolutionary models. I also find that the initial mass function in Lupus is similar to that in other nearby star-forming regions based on a comparison of their distributions of spectral types.


title: Tiered Random Matching Markets: Rank is Proportional to Popularity

abstract: We study the stable marriage problem in two-sided markets with randomly generated preferences. We consider agents on each side divided into a constant number of "soft tiers", which intuitively indicate the quality of the agent. Specifically, every agent within a tier has the same public score, and agents on each side have preferences independently generated proportionally to the public scores of the other side. We compute the expected average rank which agents in each tier have for their partners in the men-optimal stable matching, and prove concentration results for the average rank in asymptotically large markets. Furthermore, we show that despite having a significant effect on ranks, public scores do not strongly influence the probability of an agent matching to a given tier of the other side. This generalizes results of [Pittel 1989] which correspond to uniform preferences. The results quantitatively demonstrate the effect of competition due to the heterogeneous attractiveness of agents in the market, and we give the first explicit calculations of rank beyond uniform markets.


title: A local Theory of Domains and its (Noncommutative) Symbolic Counterpart

abstract: It is widely accepted nowadays that polyzetas are connected by polynomial relations. One way to obtain relations among polyzetas is to consider their generating series and the relations among these generating series. This leads to the indexation of the generating series of polylogarithms, recently described in \cite{GHM22,BHN,CM}. But, in order to understand the bridge between the extension of this "polylogarithmic calculus" and the world of harmonic sums, a local theory of domains has to be done, preserving quasi-shuffle identities, Taylor expansions and Hadamard products. In this contribution, we present a sketched version of this theory. As an example of generating series, one can consider the eulerian gamma function, \begin{eqnarray*} \Gamma(1+z)=\exp\biggl(-\gamma z+\sum_{n\ge2} \zeta(n)\dfrac{(-z)^n}{n}\biggr) {eqnarray*} and this may suggest to regularize the divergent zeta value $\zeta(1)$, for the quasi-shuffle structure, as to be Euler's $\gamma$ constant. In the same vein, in \cite{BHN}, we introduce a family of eulerian functions, \begin{eqnarray*} \Gamma_{y_k}(1+z)=\exp\biggl(\sum_{n\ge1}\zeta(kn)\dfrac{(-z^k)^n}{n}\biggr), &\mbox{for}&k\ge2,y_k\in Y=\{y_n\}_{n\ge1}. {eqnarray*} This being done, in this work, via their analytical aspects, we establish, on one side, their existence and the fact that their inverses are entire. On the other side, using the same symmetrization technique, we give their distributions of zeroes.


title: Review and Critical Analysis of Privacy-preserving Infection Tracking and Contact Tracing

abstract: The outbreak of viruses have necessitated contact tracing and infection tracking methods. Despite various efforts, there is currently no standard scheme for the tracing and tracking. Many nations of the world have therefore, developed their own ways where carriers of disease could be tracked and their contacts traced. These are generalized methods developed either in a distributed manner giving citizens control of their identity or in a centralised manner where a health authority gathers data on those who are carriers. This paper outlines some of the most significant approaches that have been established for contact tracing around the world. A comprehensive review on the key enabling methods used to realise the infrastructure around these infection tracking and contact tracing methods is also presented and recommendations are made for the most effective way to develop such a practice.


title: Adaptive Distributed Transceiver Synchronization Over a 90 Meter Microwave Wireless Link

abstract: We present an adaptive approach for synchronizing both the phase and frequency of radio-frequency transceivers over long-range wireless links to support distributed antenna array applications. To enable distributed beamforming between separate wireless nodes, the oscillators in the transceivers must operate at the same frequency, and their phases must be appropriately aligned to support phase-coherent beamsteering. Based on a spectrally-sparse waveform, a self-mixing circuit, and an adaptive control loop, we present a system capable of synchronizing the RF oscillators in separate transceivers over distances of nearly 100 m. The approach is based on a spectrally-sparse waveform for joint inter-node ranging and frequency transfer. A frequency reference is modulated onto one signal of a two-tone waveform transmitted by the primary node which is demodulated and used to lock the oscillator of the secondary node. The secondary node retransmits the two-tone signal which the primary node uses for a high-accuracy range measurement. From this range, the phase of the two transceivers can be aligned to support beamforming. We furthermore implemented an adaptive phase control approach to support high-accuracy phase coordination in changing environmental conditions. We demonstrate continuous high accuracy links over a 90 m distance in an outdoor environment for durations up to seven days, demonstrating sufficient phase coordination in changing weather conditions to support distributed beamforming at frequencies up to 3 GHz.


title: RadLex Normalization in Radiology Reports

abstract: Radiology reports have been widely used for extraction of various clinically significant information about patients' imaging studies. However, limited research has focused on standardizing the entities to a common radiology-specific vocabulary. Further, no study to date has attempted to leverage RadLex for standardization. In this paper, we aim to normalize a diverse set of radiological entities to RadLex terms. We manually construct a normalization corpus by annotating entities from three types of reports. This contains 1706 entity mentions. We propose two deep learning-based NLP methods based on a pre-trained language model (BERT) for automatic normalization. First, we employ BM25 to retrieve candidate concepts for the BERT-based models (re-ranker and span detector) to predict the normalized concept. The results are promising, with the best accuracy (78.44%) obtained by the span detector. Additionally, we discuss the challenges involved in corpus construction and propose new RadLex terms.


title: Asteroid phase curves from ATLAS dual-band photometry

abstract: Asteroid phase curves are used to derive fundamental physical properties through the determination of the absolute magnitude H. The upcoming visible Legacy Survey of Space and Time (LSST) and mid-infrared Near-Earth Object Surveillance Mission (NEOSM) surveys rely on these absolute magnitudes to derive the colours and albedos of millions of asteroids. Furthermore, the shape of the phase curves reflects their surface compositions, allowing for conclusions on their taxonomy. We derive asteroid phase curves from dual-band photometry acquired by the Asteroid Terrestrial-impact Last Alert System telescopes. Using Bayesian parameter inference, we retrieve the absolute magnitudes and slope parameters of 127,012 phase curves of 94,777 asteroids in the photometric $H, G_1, G_2$- and $H, G^*_{12}$-systems. The taxonomic complexes of asteroids separate in the observed $G_1, G_2$-distributions, correlating with their mean visual albedo. This allows for differentiating the X-complex into the P-, M-, and E-complexes using the slope parameters as alternative to albedo measurements. Further, taxonomic misclassifications from spectrophotometric datasets as well as interlopers in dynamical families of asteroids reveal themselves in $G_1, G_2$-space. The $H, G^*_{12}$-model applied to the serendipitous observations is unable to resolve target taxonomy. The $G_1, G_2$ phase coefficients show wavelength-dependency for the majority of taxonomic complexes. Serendipitous asteroid observations allow for reliable phase curve determination for a large number of asteroids. To ensure that the acquired absolute magnitudes are suited for colour computations, it is imperative that future surveys densely cover the opposition effects of the phase curves, minimizing the uncertainty on H. The phase curve slope parameters offer an accessible dimension for taxonomic classification.


title: Formalism of hydrodynamics with spin degrees of freedom

abstract: In this article we review the perfect-fluid hydrodynamics with spin framework proposed recently. This framework generalises the standard relativistic hydrodynamics framework to include spin degrees of freedom and provides a natural method to describe the spin polarization evolution of massive spin 1/2 particles. This formalism is based on the GLW (de Groot - van Leeuwen - van Weert) energy-momentum tensor and spin tensor. We show here using Bjorken model that how this spin hydrodynamics framework may be used for the determination of the observables which describes the particle polarization measured in the experiment.


title: Intelligent Ranking for Dynamic Restoration in Next Generation Wireless Networks

abstract: Emerging 5G and next generation 6G wireless are likely to involve myriads of connectivity, consisting of a huge number of relatively smaller cells providing ultra-dense coverage. Guaranteeing seamless connectivity and service level agreements in such a dense wireless system demands efficient network management and fast service recovery. However, restoration of a wireless network, in terms of maximizing service recovery, typically requires evaluating the service impact of every network element. Unfortunately, unavailability of real-time KPI information, during an outage, enforces most of the existing approaches to rely significantly on context-based manual evaluation. As a consequence, configuring a real-time recovery of the network nodes is almost impossible, thereby resulting in a prolonged outage duration. In this article, we explore deep learning to introduce an intelligent, proactive network recovery management scheme in anticipation of an eminent network outage. Our proposed method introduces a novel utilization-based ranking scheme of different wireless nodes to minimize the service downtime and enable a fast recovery. Efficient prediction of network KPI (Key Performance Index), based on actual wireless data demonstrates up to ~54% improvement in service outage.


title: 1st Place Solution to Google Landmark Retrieval 2020

abstract: This paper presents the 1st place solution to the Google Landmark Retrieval 2020 Competition on Kaggle. The solution is based on metric learning to classify numerous landmark classes, and uses transfer learning with two train datasets, fine-tuning on bigger images, adjusting loss weight for cleaner samples, and esemble to enhance the model's performance further. Finally, it scored 0.38677 mAP@100 on the private leaderboard.


title: Finite-Alphabet Wiener Filter Precoding for mmWave Massive MU-MIMO Systems

abstract: Power consumption of multi-user (MU) precoding is a major concern in all-digital massive MU multiple-input multiple-output (MIMO) base-stations with hundreds of antenna elements operating at millimeter-wave (mmWave) frequencies. We propose to replace part of the linear Wiener filter (WF) precoding matrix by a finite-alphabet WF precoding (FAWP) matrix, which enables the use of low-precision hardware that consumes low power and area. To minimize the performance loss of our approach, we present methods that efficiently compute FAWP matrices that best mimic the WF precoder. Our results show that FAWP matrices approach infinite-precision error-rate and error-vector magnitude performance with only 3-bit precoding weights, even when operating in realistic mmWave channels. Hence, FAWP is a promising approach to substantially reduce power consumption and silicon area in all-digital mmWave massive MU-MIMO systems.


title: Computer proofs for Property (T), and SDP duality

abstract: We show that the semidefinite programs involved in the computer proofs for Kazhdan's property (T) satisfy strong duality and that the dual programs have a geometric interpretation in terms of harmonic cocycles. By dualizing geometric arguments about cocycles, we are able to simplify the property (T) SDP in the case where it carries a symmetry by finite-order inner automorphisms. As an application, we simplify the SDP proof for $SL(n,\mathbb{Z})$ and we prove that $Aut(F_4)$ has property (T).


title: Deep Switching Auto-Regressive Factorization:Application to Time Series Forecasting

abstract: We introduce deep switching auto-regressive factorization (DSARF), a deep generative model for spatio-temporal data with the capability to unravel recurring patterns in the data and perform robust short- and long-term predictions. Similar to other factor analysis methods, DSARF approximates high dimensional data by a product between time dependent weights and spatially dependent factors. These weights and factors are in turn represented in terms of lower dimensional latent variables that are inferred using stochastic variational inference. DSARF is different from the state-of-the-art techniques in that it parameterizes the weights in terms of a deep switching vector auto-regressive likelihood governed with a Markovian prior, which is able to capture the non-linear inter-dependencies among weights to characterize multimodal temporal dynamics. This results in a flexible hierarchical deep generative factor analysis model that can be extended to (i) provide a collection of potentially interpretable states abstracted from the process dynamics, and (ii) perform short- and long-term vector time series prediction in a complex multi-relational setting. Our extensive experiments, which include simulated data and real data from a wide range of applications such as climate change, weather forecasting, traffic, infectious disease spread and nonlinear physical systems attest the superior performance of DSARF in terms of long- and short-term prediction error, when compared with the state-of-the-art methods.


title: The R136 star cluster dissected with Hubble Space Telescope/STIS. II. Physical properties of the most massive stars in R136

abstract: We present an optical analysis of 55 members of R136, the central cluster in the Tarantula Nebula of the Large Magellanic Cloud. Our sample was observed with STIS aboard the Hubble Space Telescope, is complete down to about 40\,$M_{\odot}$, and includes 7 very massive stars with masses over 100\,$M_{\odot}$. We performed a spectroscopic analysis to derive their physical properties. Using evolutionary models we find that the initial mass function (IMF) of massive stars in R136 is suggestive of being top-heavy with a power-law exponent $\gamma \approx 2 \pm 0.3$, but steeper exponents cannot be excluded. The age of R136 lies between 1 and 2\,Myr with a median age of around 1.6\,Myr. Stars more luminous than $\log L/L_{\odot} = 6.3$ are helium enriched and their evolution is dominated by mass loss, but rotational mixing or some other form of mixing could be still required to explain the helium composition at the surface. Stars more massive than 40\,$M_{\odot}$ have larger spectroscopic than evolutionary masses. The slope of the wind-luminosity relation assuming unclumped stellar winds is $2.41\pm0.13$ which is steeper than usually obtained ($\sim 1.8$). The ionising ($\log Q_0\,[{\rm ph/s}] = 51.4$) and mechanical ($\log L_{\rm SW}\,[{\rm erg/s}] = 39.1$) output of R136 is dominated by the most massive stars ($>100\,M_{\odot}$). R136 contributes around a quarter of the ionising flux and around a fifth of the mechanical feedback to the overall budget of the Tarantula Nebula. For a census of massive stars of the Tarantula Nebula region we combined our results with the VLT-FLAMES Tarantula Survey plus other spectroscopic studies. We observe a lack of evolved Wolf-Rayet stars and luminous blue and red supergiants.


title: Signatures of a spin-1/2 cooperative paramagnet in the diluted triangular lattice of Y$_2$CuTiO$_6$

abstract: We present a combination of thermodynamic and dynamic experimental signatures of a disorder driven dynamic cooperative paramagnet in a 50% site diluted triangular lattice spin-1/2 system, Y$_2$CuTiO$_6$. Magnetic ordering and spin freezing are absent down to 50 mK, far below the Curie Weiss scale of ~-134 K. We observe scaling collapses of the magnetic field- and temperature-dependent magnetic heat capacity and magnetisation data, respectively, in conformity with expectations from the random singlet physics. Our experiments establish the suppression of any freezing scale, if at all present, by more than three orders of magnitude, opening a plethora of interesting possibilities such as disorder-stabilized long range quantum entangled ground states.


title: Learning Product Rankings Robust to Fake Users

abstract: In many online platforms, customers' decisions are substantially influenced by product rankings as most customers only examine a few top-ranked products. Concurrently, such platforms also use the same data corresponding to customers' actions to learn how these products must be ranked or ordered. These interactions in the underlying learning process, however, may incentivize sellers to artificially inflate their position by employing fake users, as exemplified by the emergence of click farms. Motivated by such fraudulent behavior, we study the ranking problem of a platform that faces a mixture of real and fake users who are indistinguishable from one another. We first show that existing learning algorithms---that are optimal in the absence of fake users---may converge to highly sub-optimal rankings under manipulation by fake users. To overcome this deficiency, we develop efficient learning algorithms under two informational environments: in the first setting, the platform is aware of the number of fake users, and in the second setting, it is agnostic to the number of fake users. For both these environments, we prove that our algorithms converge to the optimal ranking, while being robust to the aforementioned fraudulent behavior; we also present worst-case performance guarantees for our methods, and show that they significantly outperform existing algorithms. At a high level, our work employs several novel approaches to guarantee robustness such as: (i) constructing product-ordering graphs that encode the pairwise relationships between products inferred from the customers' actions; and (ii) implementing multiple levels of learning with a judicious amount of bi-directional cross-learning between levels.


title: SWP-LeafNET: A novel multistage approach for plant leaf identification based on deep CNN

abstract: Modern scientific and technological advances allow botanists to use computer vision-based approaches for plant identification tasks. These approaches have their own challenges. Leaf classification is a computer-vision task performed for the automated identification of plant species, a serious challenge due to variations in leaf morphology, including its size, texture, shape, and venation. Researchers have recently become more inclined toward deep learning-based methods rather than conventional feature-based methods due to the popularity and successful implementation of deep learning methods in image analysis, object recognition, and speech recognition. In this paper, to have an interpretable and reliable system, a botanist's behavior is modeled in leaf identification by proposing a highly-efficient method of maximum behavioral resemblance developed through three deep learning-based models. Different layers of the three models are visualized to ensure that the botanist's behavior is modeled accurately. The first and second models are designed from scratch. Regarding the third model, the pre-trained architecture MobileNetV2 is employed along with the transfer-learning technique. The proposed method is evaluated on two well-known datasets: Flavia and MalayaKew. According to a comparative analysis, the suggested approach is more accurate than hand-crafted feature extraction methods and other deep learning techniques in terms of 99.67% and 99.81% accuracy. Unlike conventional techniques that have their own specific complexities and depend on datasets, the proposed method requires no hand-crafted feature extraction. Also, it increases accuracy as compared with other deep learning techniques. Moreover, SWP-LeafNET is distributable and considerably faster than other methods because of using shallower models with fewer parameters asynchronously.


title: Dynamical Chaos in a Simple Model of a Knuckleball

abstract: The knuckleball is perhaps the most enigmatic pitch in baseball. Relying on the presence of raised seams on the surface of the ball to create asymmetric flow, a knuckleball's trajectory has proven very challenging to predict compared to other baseball pitches, such as fastballs or curveballs. Previous experimental tracking of large numbers of knuckleballs has shown that they can move in essentially any direction relative to what would be expected from a drag-only trajectory. This has led to speculation that knuckleballs exhibit chaotic motion. Here we develop a relatively simple model of a knuckleball that includes quadratic drag and lift from asymmetric flow which is taken from experimental measurements of slowly rotating baseballs. Our models can indeed exhibit dynamical chaos as long In contrast, models that omit torques on the ball in flight do not show chaotic behavior. Uncertainties in the phase space position of the knuckleball are shown to grow by factors as large as $10^6$ over the flight of the ball from the pitcher to home plate. We quantify the impact of our model parameters on the chaos realized in our models, specifically showing that maximum Lyapunov exponent is roughly proportional to the square root of the effective lever arm of the torque, and also roughly proportional to the initial velocity of the pitch. We demonstrate the existence of bifurcations that can produce changes in the location of the ball when it reaches the plate of as much as 1.2 m for specific initial conditions similar to those used by professional knuckleball pitchers. As we introduce additional complexity in the form of more faithful representations of the empirical asymmetry force measurements, we find that a larger fraction of the possible initial conditions result in dynamical chaos.


title: Finding hidden order in spin models with persistent homology

abstract: Persistent homology (PH) is a relatively new field in applied mathematics that studies the components and shapes of discrete data. In this work, we demonstrate that PH can be used as a universal framework to identify phases in spin models, including hidden order such as spin nematic ordering and spin liquids. By converting a small number of spin configurations to barcodes we obtain a descriptive picture of configuration space. Using dimensionality reduction to reduce the barcode space to color space leads to a visualization of the phase diagram.


title: Portfolio Decisions and Brain Reactions via the CEAD method

abstract: Decision making can be a complex process requiring the integration of several attributes of choice options. Understanding the neural processes underlying (uncertain) investment decisions is an important topic in neuroeconomics. We analyzed functional magnetic resonance imaging (fMRI) data from an investment decision study for stimulus-related effects. We propose a new technique for identifying activated brain regions: Cluster, Estimation, Activation and Decision (CEAD) method. Our analysis is focused on clusters of voxels rather than voxel units. Thus, we achieve a higher signal to noise ratio within the unit tested and a smaller number of hypothesis tests compared with the often used General Linear Model (GLM). We propose to first conduct the brain parcellation by applying spatially constrained spectral clustering. The information within each cluster can then be extracted by the flexible Dynamic Semiparametric Factor Model (DSFM) dimension reduction technique and finally be tested for differences in activation between conditions. This sequence of Cluster, Estimation, Activation and Decision admits a model-free analysis of the local fMRI signal. Applying a GLM on the DSFM-based time series resulted in a significant correlation between the risk of choice options and changes in fMRI signal in the anterior insula and dorsomedial prefrontal cortex. Additionally, individual differences in decision-related reactions within the DSFM time series predicted individual differences in risk attitudes as modeled with the framework of the mean-variance model.


title: Model Dependence of Bayesian Gravitational-Wave Background Statistics for Pulsar Timing Arrays

abstract: Pulsar timing array (PTA) searches for a gravitational-wave background (GWB) typically include time-correlated "red" noise models intrinsic to each pulsar. Using a simple simulated PTA dataset with an injected GWB signal we show that the details of the red noise models used, including the choice of amplitude priors and even which pulsars have red noise, have a striking impact on the GWB statistics, including both upper limits and estimates of the GWB amplitude. We find that the standard use of uniform priors on the red noise amplitude leads to 95% upper limits, as calculated from one-sided Bayesian credible intervals, that are less than the injected GWB amplitude 50% of the time. In addition, amplitude estimates of the GWB are systematically lower than the injected value by 10-40%, depending on which models and priors are chosen for the intrinsic red noise. We tally the effects of model and prior choice and demonstrate how a "dropout" model, which allows flexible use of red noise models in a Bayesian approach, can improve GWB estimates throughout.

categories: astro-ph.IM astro-ph.HE gr-qc physics.data-an


title: Auto-encoders for Track Reconstruction in Drift Chambers for CLAS12

abstract: In this article we describe the development of machine learning models to assist the CLAS12 tracking algorithm by identifying tracks through inferring missing segments in the drift chambers. Auto encoders are used to reconstruct missing segments from track trajectory. Implemented neural network was able to reliably reconstruct missing segment positions with accuracy of $\approx 0.35$ wires, and lead to recovery of missing tracks with accuracy of $>99.8\%$.


title: Homology concordance and an infinite rank free subgroup

abstract: Two knots are homology concordant if they are smoothly concordant in a homology cobordism. The group $\hat{\mathcal{C}}_{\mathbb{Z}}$ (resp. $\mathcal{C}_{\mathbb{Z}}$) was previously defined as the set of knots in homology spheres that bounds homology balls (resp. in $S^3$), modulo homology concordance. We prove $\hat{\mathcal{C}}_{\mathbb{Z}} / \mathcal{C}_{\mathbb{Z}}$ contains a $\mathbb{Z}^{\infty}$ subgroup. We construct our family of examples by applying the filtered mapping cone formula to $L$--space knots, and prove linear independence with the help of the connected knot complex.


title: Simphony: An open-source photonic integrated circuit simulation framework

abstract: We present Simphony, a free and open-source software toolbox for abstracting and simulating photonic integrated circuits, implemented in Python. The toolbox is both fast and easily extensible; plugins can be written to provide compatibility with existing layout tools, and device libraries can be easily created without a deep knowledge of programming. We include several examples of photonic circuit simulations with novel features and demonstrate a speedup of more than 20x over a leading commercially available software tool.


title: Practical Cross-modal Manifold Alignment for Grounded Language

abstract: We propose a cross-modality manifold alignment procedure that leverages triplet loss to jointly learn consistent, multi-modal embeddings of language-based concepts of real-world items. Our approach learns these embeddings by sampling triples of anchor, positive, and negative data points from RGB-depth images and their natural language descriptions. We show that our approach can benefit from, but does not require, post-processing steps such as Procrustes analysis, in contrast to some of our baselines which require it for reasonable performance. We demonstrate the effectiveness of our approach on two datasets commonly used to develop robotic-based grounded language learning systems, where our approach outperforms four baselines, including a state-of-the-art approach, across five evaluation metrics.


title: A new heuristic algorithm for fast k-segmentation

abstract: The $k$-segmentation of a video stream is used to partition it into $k$ piecewise-linear segments, so that each linear segment has a meaningful interpretation. Such segmentation may be used to summarize large videos using a small set of images, to identify anomalies within segments and change points between segments, and to select critical subsets for training machine learning models. Exact and approximate segmentation methods for $k$-segmentation exist in the literature. Each of these algorithms occupies a different spot in the trade-off between computational complexity and accuracy. A novel heuristic algorithm is proposed in this paper to improve upon existing methods. It is empirically found to provide accuracies competitive with exact methods at a fraction of the computational expense. The new algorithm is inspired by Lloyd's algorithm for K-Means and Lloyd-Max algorithm for scalar quantization, and is called the LM algorithm for convenience. It works by iteratively minimizing a cost function from any given initialisation; the commonly used $L_2$ cost is chosen in this paper. While the greedy minimization makes the algorithm sensitive to initialisation, the ability to converge from any initial guess to a local optimum allows the algorithm to be integrated into other existing algorithms. Three variants of the algorithm are tested over a large number of synthetic datasets, one being a standalone LM implementation, and two others that combine with existing algorithms. One of the latter two -- LM-enhanced-Bottom-Up segmentation -- is found to have the best accuracy and the lowest computational complexity among all algorithms. This variant of LM can provide $k$-segmentations over data sets with up to a million image frames within several seconds.


title: Neutron Polarimetry Using a Polarized 3He Cell for the aCORN Experiment

abstract: The neutron polarization of the NG-C beamline at the NIST Center for Neutron Research was measured as part of the aCORN neutron beta decay experiment. Neutron transmission through a polarized 3He spin filter cell was recorded while adiabatic fast passage (AFP) nuclear magnetic resonance (NMR) reversed the polarization direction of the 3He in an eight-step sequence to account for drifts. The dependence of the neutron transmission on the spin filter direction was used to calculate the neutron polarization. The time dependent transmission was fit to a model which included the neutron spectrum, and 3He polarization losses from spin relaxation and AFP-NMR. The polarization of the NG-C beamline was found to be ${\mid}P_\mathrm{n}{\mid} \leq 4\times 10^{-4}$ with 90 % confidence.


title: Inference for high-dimensional exchangeable arrays

abstract: We consider inference for high-dimensional separately and jointly exchangeable arrays where the dimensions may be much larger than the sample sizes. For both exchangeable arrays, we first derive high-dimensional central limit theorems over the rectangles and subsequently develop novel multiplier bootstraps with theoretical guarantees. These theoretical results rely on new technical tools such as Hoeffding-type decomposition and maximal inequalities for the degenerate components in the Hoeffiding-type decomposition for the exchangeable arrays. We exhibit applications of our methods to uniform confidence bands for density estimation under joint exchangeability and penalty choice for $\ell_1$-penalized regression under separate exchangeability. Extensive simulations demonstrate precise uniform coverage rates. We illustrate by constructing uniform confidence bands for international trade network densities.


title: Table-top Nonlinear Extreme Ultraviolet Spectroscopy

abstract: The lack of available table-top extreme ultraviolet (XUV) sources with high enough fluxes and coherence properties have limited the availability of nonlinear XUV and x-ray spectroscopies to free electron lasers (FEL). Here, we demonstrate second harmonic generation (SHG) on a table-top XUV source for the first time by observing SHG at the Ti M2,3-edge with a high harmonic seeded soft x-ray laser (HHG-SXRL) [1,2]. Further, this experiment represents the first SHG experiment in the XUV. First-principles electronic structure calculations are used to confirm the surface specificity and resonant enhancement of the SHG signal. The realization of XUV-SHG on a table-top source with femtosecond temporal resolution opens up tremendous opportunities for the study of element-specific dynamics in multi-component systems where surface, interfacial, and bulk-phase asymmetries play a driving role in smaller-scale labs as opposed to FELs.


title: CasGCN: Predicting future cascade growth based on information diffusion graph

abstract: Sudden bursts of information cascades can lead to unexpected consequences such as extreme opinions, changes in fashion trends, and uncontrollable spread of rumors. It has become an important problem on how to effectively predict a cascade' size in the future, especially for large-scale cascades on social media platforms such as Twitter and Weibo. However, existing methods are insufficient in dealing with this challenging prediction problem. Conventional methods heavily rely on either hand crafted features or unrealistic assumptions. End-to-end deep learning models, such as recurrent neural networks, are not suitable to work with graphical inputs directly and cannot handle structural information that is embedded in the cascade graphs. In this paper, we propose a novel deep learning architecture for cascade growth prediction, called CasGCN, which employs the graph convolutional network to extract structural features from a graphical input, followed by the application of the attention mechanism on both the extracted features and the temporal information before conducting cascade size prediction. We conduct experiments on two real-world cascade growth prediction scenarios (i.e., retweet popularity on Sina Weibo and academic paper citations on DBLP), with the experimental results showing that CasGCN enjoys a superior performance over several baseline methods, particularly when the cascades are of large scale.


title: Red Supergiants, Yellow Hypergiants, and Post-RSG Evolution

abstract: How massive stars end their lives remains an open question in the field of star evolution. While the majority of stars above 9 M_sun will become red supergiants (RSGs), the terminal state of these massive stars can be heavily influenced by their mass-loss histories. Periods of enhanced circumstellar wind activity can drive stars off the RSG branch of the HR Diagram. This phase, known as post-RSG evolution, may well be tied to high mass-loss events or eruptions as seen in the Luminous Blue Variables and other massive stars. This article highlights some of the recent observational and modeling studies that seek to characterize this unique class of stars, the post-RSGs, and link them to other massive objects on the HR Diagram such as LBVs, Yellow Hypergiants, and dusty RSGs.


title: Super Star Clusters in the Central Starburst of NGC 4945

abstract: NGC 4945 is a nearby (3.8 Mpc) galaxy hosting a nuclear starburst and Seyfert Type 2 AGN. We use the Atacama Large Millimeter/submillimeter Array (ALMA) to image the 93 GHz (3.2 mm) free-free continuum and hydrogen recombination line emission (H40$\alpha$ and H42$\alpha$) at 2.2 pc (0.12'') resolution. Our observations reveal 27 bright, compact sources with FWHM sizes of 1.4 - 4.0 pc, which we identify as candidate super star clusters. Recombination line emission, tracing the ionizing photon rate of the candidate clusters, is detected in 15 sources, 6 of which have a significant synchrotron component to the 93 GHz continuum. Adopting an age of ~5 Myr, the stellar masses implied by the ionizing photon luminosities are $\log_{10}$($M_{\star}$/M$_{\odot}$) $\approx$ 4.7 - 6.1. We fit a slope to the cluster mass distribution and find $\beta = -1.8 \pm 0.4$. The gas masses associated with these clusters, derived from the dust continuum at 350 GHz, are typically an order of magnitude lower than the stellar mass. These candidate clusters appear to have already converted a large fraction of their dense natal material into stars and, given their small free-fall times of ~0.05 Myr, are surviving an early volatile phase. We identify a point-like source in 93 GHz continuum emission which is presumed to be the AGN. We do not detect recombination line emission from the AGN and place an upper limit on the ionizing photons which leak into the starburst region of $Q_0 < 10^{52}$ s$^{-1}$.


title: A spectral signature of breaking of ensemble equivalence for constrained random graphs

abstract: For random systems subject to a constraint, the microcanonical ensemble requires the constraint to be met by every realisation ("hard constraint"), while the canonical ensemble requires the constraint to be met only on average ("soft constraint"). It is known that for random graphs subject to topological constraints breaking of ensemble equivalence may occur when the size of the graph tends to infinity, signalled by a non-vanishing specific relative entropy of the two ensembles. We investigate to what extent breaking of ensemble equivalence is manifested through the largest eigenvalue of the adjacency matrix of the graph. We consider two examples of constraints in the dense regime: (1) fix the degrees of the vertices (= the degree sequence); (2) fix the sum of the degrees of the vertices (= twice the number of edges). Example (1) imposes an extensive number of local constraints and is known to lead to breaking of ensemble equivalence. Example (2) imposes a single global constraint and is known to lead to ensemble equivalence. Our working hypothesis is that breaking of ensemble equivalence corresponds to a non-vanishing difference of the expected values of the largest eigenvalue under the two ensembles. We verify that, in the limit as the size of the graph tends to infinity, the difference between the expected values of the largest eigenvalue in the two ensembles does not vanish for (1) and vanishes for (2). A key tool in our analysis is a transfer method that uses relative entropy to determine whether probabilistic estimates can be carried over from the canonical ensemble to the microcanonical ensemble, and illustrates how breaking of ensemble equivalence may prevent this from being possible.


title: The Up Topology for Mirrored Topological Posets

abstract: For a discrete poset $\mathcal X$, McCord proved that the natural map $|{\mathcal X}|\to {\mathcal X}$, from the order complex to the poset with the Up topology, is a weak homotopy equivalence. Much later, \u{Z}ivaljevi\'{c} defined the notion of order complex for a topological poset. For a large class of such topological posets we prove the analog of McCord's theorem, namely that the natural map from the order complex to the topological poset with the Up topology is a weak homotopy equivalence. An example is the Grassmann poset of proper non-zero linear subspaces of $\R^{n+1}$. Here, Vassiliev had computed the homotopy type of the order complex. Our theorem allows us to transfer that information (up to weak homotopy type) to the Grassmann poset itself with the Up topology.


title: Lecture Notes on "Random Matrices"

abstract: This in an introduction to random matrix theory, giving an impression of some of the most important aspects of this modern subject. In particular, it covers the basic combinatorial and analytic theory around Wigner's semicircle law, featuring also concentration phenomena, and the Tracy-Widom distribution of the largest eigenvalue. The circular law and a discussion of Voiculescu's multivariate extension of the semicircle law, as an appetizer for free probability theory, also make an appearance. The material here was presented in the winter term 2019/20 at Saarland University in 24 lectures of 90 minutes each. The lectures were recorded and can be found online at https://www.math.uni-sb.de/ag/speicher/web_video/index.html.


title: OCR Graph Features for Manipulation Detection in Documents

abstract: Detecting manipulations in digital documents is becoming increasingly important for information verification purposes. Due to the proliferation of image editing software, altering key information in documents has become widely accessible. Nearly all approaches in this domain rely on a procedural approach, using carefully generated features and a hand-tuned scoring system, rather than a data-driven and generalizable approach. We frame this issue as a graph comparison problem using the character bounding boxes, and propose a model that leverages graph features using OCR (Optical Character Recognition). Our model relies on a data-driven approach to detect alterations by training a random forest classifier on the graph-based OCR features. We evaluate our algorithm's forgery detection performance on dataset constructed from real business documents with slight forgery imperfections. Our proposed model dramatically outperforms the most closely-related document manipulation detection model on this task.


title: Oiling-out Crystallization of Beta-Alanine onSolid Surfaces Controlled by Solvent Exchange

abstract: Droplet formation in oiling-out crystallization has important implication for separation and purification of pharmaceutical active ingredients by using an antisolvent. In this work, we report the crystallization processes of oiling-out droplets on surfaces during solvent exchange. Our model ternary solution is beta-alanine dissolved in isopropanol and water mixture. As the antisolvent isopropanol displaced the alanine solution pre-filled in a microchamber, liquid-liquid phase separation occurred at the mixing front. The alanine-rich subphase formed surface microdroplets that subsequently crystallized with progression of solvent exchange. We find that the flow rates have significant influence on the droplet size, crystallization process, and growth rate, and final morphology of the crystals. At fast flow rates the droplets solidified rapidly and formed spherical-cap structures resembling the shape of droplets, in contrast to crystal microdomains or thin films formed at slow flow rates. On a highly hydrophilic surface, the crystals formed thin film without droplets formed on the surface. We further demonstrated that by the solvent exchange crystals can be formed by using a stock solution with a very low concentration of the precursor, and the as-prepared crystals can be used as seeds to trigger crystallization in bulk solution. Our results suggest that the solvent exchange has the potential to be an effective approach for controlling oiling-out crystallization, which can be applied in wide areas, such as separation and purification of many food, medical, and therapeutic ingredients.


title: Rank over Class: The Untapped Potential of Ranking in Natural Language Processing

abstract: Text classification has long been a staple within Natural Language Processing (NLP) with applications spanning across diverse areas such as sentiment analysis, recommender systems and spam detection. With such a powerful solution, it is often tempting to use it as the go-to tool for all NLP problems since when you are holding a hammer, everything looks like a nail. However, we argue here that many tasks which are currently addressed using classification are in fact being shoehorned into a classification mould and that if we instead address them as a ranking problem, we not only improve the model, but we achieve better performance. We propose a novel end-to-end ranking approach consisting of a Transformer network responsible for producing representations for a pair of text sequences, which are in turn passed into a context aggregating network outputting ranking scores used to determine an ordering to the sequences based on some notion of relevance. We perform numerous experiments on publicly-available datasets and investigate the applications of ranking in problems often solved using classification. In an experiment on a heavily-skewed sentiment analysis dataset, converting ranking results to classification labels yields an approximately 22% improvement over state-of-the-art text classification, demonstrating the efficacy of text ranking over text classification in certain scenarios.


title: Multi-Goal Multi-Agent Path Finding via Decoupled and Integrated Goal Vertex Ordering

abstract: We introduce multi-goal multi agent path finding (MAPF$^{MG}$) which generalizes the standard discrete multi-agent path finding (MAPF) problem. While the task in MAPF is to navigate agents in an undirected graph from their starting vertices to one individual goal vertex per agent, MAPF$^{MG}$ assigns each agent multiple goal vertices and the task is to visit each of them at least once. Solving MAPF$^{MG}$ not only requires finding collision free paths for individual agents but also determining the order of visiting agent's goal vertices so that common objectives like the sum-of-costs are optimized. We suggest two novel algorithms using different paradigms to address MAPF$^{MG}$: a heuristic search-based search algorithm called Hamiltonian-CBS (HCBS) and a compilation-based algorithm built using the SMT paradigm, called SMT-Hamiltonian-CBS (SMT-HCBS). Experimental comparison suggests limitations of compilation-based approach.


title: Estimation of all parameters in the reflected Orntein-Uhlenbeck process from discrete observations

abstract: Assuming that a reflected Ornstein-Uhlenbeck state process is observed at discrete time instants, we propose generalized moment estimators to estimate all drift and diffusion parameters via the celebrated ergodic theorem. With the sampling time step h > 0 arbitrarily fixed, we prove the strong consistency and asymptotic normality of our estimators as the sampling size n tends to infinity. This provides a complete solution to an open problem left in Hu et al. [5].


title: Direct prediction of phonon density of states with Euclidean neural networks

abstract: Machine learning has demonstrated great power in materials design, discovery, and property prediction. However, despite the success of machine learning in predicting discrete properties, challenges remain for continuous property prediction. The challenge is aggravated in crystalline solids due to crystallographic symmetry considerations and data scarcity. Here we demonstrate the direct prediction of phonon density of states using only atomic species and positions as input. We apply Euclidean neural networks, which by construction are equivariant to 3D rotations, translations, and inversion and thereby capture full crystal symmetry, and achieve high-quality prediction using a small training set of $\sim 10^{3}$ examples with over 64 atom types. Our predictive model reproduces key features of experimental data and even generalizes to materials with unseen elements,and is naturally suited to efficiently predict alloy systems without additional computational cost. We demonstrate the potential of our network by predicting a broad number of high phononic specific heat capacity materials. Our work indicates an efficient approach to explore materials' phonon structure, and can further enable rapid screening for high-performance thermal storage materials and phonon-mediated superconductors.


title: Conformally invariant rigidity theorems on four-manifolds with boundary

abstract: In the article we introduce new conformal and smooth invariants on compact, oriented four-manifolds with boundary. In the first part, we show that "positivity" conditions on these invariants will impose topological restrictions on underlying manifolds with boundary, which generalizes the results on closed four-manifolds by M. Gursky and on conformally compact Einstein four-manifolds by S.-Y. A. Chang, J. Qing, and P. Yang. In the second part, we study Weyl functional on four-manifolds with boundary and establish several conformally invariant rigidity theorems. As applications, we prove some rigidity theorems for conformally compact Einstein four-manifolds. These results generalize the work on closed four-manifolds by S.-Y. A. Chang, J. Qing, and P. Yang and rigidity theorem for conformally compact Einstein four-manifolds by G. Li, J. Qing, and Y. Shi. A crucial idea of the proofs is to understand the expansion of a smooth Riemannian metric near the boundary. It is noteworthy to point out that we rule out some examples arising from the study of closed manifolds in the setting of manifolds with umbilic boundary.


title: Sentinel: An Onboard Lane Change Advisory System for Intelligent Vehicles to Reduce Traffic Delay during Freeway Incidents

abstract: This paper introduces Sentinel, an onboard system for intelligent vehicles that guides their lane changing behavior during a freeway incident with the goal of reducing traffic congestion, capacity drop, and delay. When an incident blocking the lanes ahead is detected, Sentinel calculates the probability of leaving the blocked lane(s) before reaching the incident point at each time step. It advises the vehicle to leave the blocked lane(s) when that probability drops below a certain threshold, as the vehicle nears the congestion boundary. By doing this, Sentinel reduces the number of late-stage lane changes of vehicles in the blocked lane(s) trying to move to other lanes, and distributes those maneuvers upstream of the incident point. A simulation case study is conducted in which one lane of a four-lane section of the I-66 interstate highway in the U.S. is temporarily blocked due to an incident, to understand how Sentinel impacts traffic flow and how different parameters - traffic flow, system penetration rate, and incident duration - affect Sentinel's performance. The results show that Sentinel has a positive impact on traffic flow, reducing average delay by up to 37%, particularly when it has a considerable penetration rate. Working alongside Traffic Incident Management Systems (TIMS), Sentinel can be a valuable asset for reducing traffic delay and potentially saving billions of dollars annually in costs associated with congestion caused by freeway incidents.


title: FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding

abstract: Large-scale cross-lingual language models (LM), such as mBERT, Unicoder and XLM, have achieved great success in cross-lingual representation learning. However, when applied to zero-shot cross-lingual transfer tasks, most existing methods use only single-language input for LM finetuning, without leveraging the intrinsic cross-lingual alignment between different languages that proves essential for multilingual tasks. In this paper, we propose FILTER, an enhanced fusion method that takes cross-lingual data as input for XLM finetuning. Specifically, FILTER first encodes text input in the source language and its translation in the target language independently in the shallow layers, then performs cross-language fusion to extract multilingual knowledge in the intermediate layers, and finally performs further language-specific encoding. During inference, the model makes predictions based on the text input in the target language and its translation in the source language. For simple tasks such as classification, translated text in the target language shares the same label as the source language. However, this shared label becomes less accurate or even unavailable for more complex tasks such as question answering, NER and POS tagging. To tackle this issue, we further propose an additional KL-divergence self-teaching loss for model training, based on auto-generated soft pseudo-labels for translated text in the target language. Extensive experiments demonstrate that FILTER achieves new state of the art on two challenging multilingual multi-task benchmarks, XTREME and XGLUE.


title: Accelerating Real-Time Question Answering via Question Generation

abstract: Although deep neural networks have achieved tremendous success for question answering (QA), they are still suffering from heavy computational and energy cost for real product deployment. Further, existing QA systems are bottlenecked by the encoding time of real-time questions with neural networks, thus suffering from detectable latency in deployment for large-volume traffic. To reduce the computational cost and accelerate real-time question answering (RTQA) for practical usage, we propose to remove all the neural networks from online QA systems, and present Ocean-Q (an Ocean of Questions), which introduces a new question generation (QG) model to generate a large pool of QA pairs offline, then in real time matches an input question with the candidate QA pool to predict the answer without question encoding. Ocean-Q can be readily deployed in existing distributed database systems or search engine for large-scale query usage, and much greener with no additional cost for maintaining large neural networks. Experiments on SQuAD(-open) and HotpotQA benchmarks demonstrate that Ocean-Q is able to accelerate the fastest state-of-the-art RTQA system by 4X times, with only a 3+% accuracy drop.


title: Towards Safe Locomotion Navigation in Partially Observable Environments with Uneven Terrain

abstract: This study proposes an integrated task and motion planning method for dynamic locomotion in partially observable environments with multi-level safety guarantees. This layered planning framework is composed of a high-level symbolic task planner and a low-level phase-space motion planner. A belief abstraction at the task planning level enables belief estimation of dynamic obstacle locations and guarantees navigation safety with collision avoidance. The high-level task planner, i.e., a two-level navigation planner, employs linear temporal logic for a reactive game synthesis between the robot and its environment while incorporating low-level safe keyframe policies into formal task specification design. The synthesized task planner commands a series of locomotion actions including walking step length, step height, and heading angle changes, to the underlying keyframe decision-maker, which further determines the robot center-of-mass apex velocity keyframe. The low-level phase-space planner uses a reduced-order locomotion model to generate non-periodic trajectories meeting balancing safety criteria for straight and steering walking. These criteria are characterized by constraints on locomotion keyframe states, and are used to define keyframe transition policies via viability kernels. Simulation results of a Cassie bipedal robot designed by Agility Robotics demonstrate locomotion maneuvering in a three-dimensional, partially observable environment consisting of dynamic obstacles and uneven terrain.


title: Sparsifying Transformer Models with Trainable Representation Pooling

abstract: We propose a novel method to sparsify attention in the Transformer model by learning to select the most-informative token representations during the training process, thus focusing on the task-specific parts of an input. A reduction of quadratic time and memory complexity to sublinear was achieved due to a robust trainable top-$k$ operator. Our experiments on a challenging long document summarization task show that even our simple baseline performs comparably to the current SOTA, and with trainable pooling, we can retain its top quality, while being $1.8\times$ faster during training, $4.5\times$ faster during inference, and up to $13\times$ more computationally efficient in the decoder.


title: Extraordinary Phase Coherence Length in Epitaxial Halide Perovskites

abstract: Inorganic halide perovskites have emerged as a promising platform in a wide range of applications from solar energy harvesting to computing, and light emission. The recent advent of epitaxial thin film growth of halide perovskites has made it possible to investigate low-dimensional quantum electronic devices based on this class of materials. This study leverages advances in vapor-phase epitaxy of halide perovskites to perform low-temperature magnetotransport measurements on single-domain cesium tin iodide (CsSnI$_3$) epitaxial thin films. The low-field magnetoresistance carries signatures of coherent quantum interference effects and spin-orbit coupling. These weak anti-localization measurements reveal a micron-scale low-temperature phase coherence length for charge carriers in this system. The results indicate that epitaxial halide perovskite heterostructures are a promising platform for investigating long coherent quantum electronic effects and potential applications in spintronics and spin-orbitronics.


title: Power and sample size for cluster randomized and stepped wedge trials: Comparing estimates obtained by applying design effects or by direct estimation in GLMM

abstract: When observations are independent, formulae and software are readily available to plan and design studies of appropriate size and power to detect important associations. When observations are correlated or clustered, results obtained from the standard software require adjustment. This tutorial compares two approaches, using examples that illustrate various designs for both independent and clustered data. One approach obtains initial estimates using software that assume independence among observations, then adjusts these estimates using a design effect (DE), also called a variance inflation factor (VIF). A second approach generates estimates using generalized linear mixed models (GLMM) that account directly for patterns of clustering and correlation. The two approaches generally produce similar estimates and so validate one another. For certain clustered designs, small differences in power estimates emphasize the importance of specifying an alternative hypothesis in terms of means but also in terms of expected variances and covariances. Both approaches to power estimation are sensitive to assumptions concerning the structure or pattern of independence or correlation among clustered outcomes.


title: Subradiance with saturated atoms: population enhancement of the long-lived states

abstract: Dipole-dipole interactions are at the origin of long-lived collective atomic states, often called subradiant, which are explored for their potential use in novel photonic devices or in quantum protocols. Here, we study subradiance beyond linear optics and experimentally demonstrate a two hundred-fold increase in the population of these modes, as the saturation parameter of the driving field is increased. We attribute this enhancement to a mechanism similar to optical pumping through the well-coupled superradiant states. The lifetimes are unaffected by the pump strength, as the system is ultimately driven toward the single-excitation sector.


title: Limit Behavior of the Rational Powers of Monomial Ideals

abstract: We investigate the rational powers of ideals. We find that in the case of monomial ideals, the canonical indexing leads to a characterization of the rational powers yielding that symbolic powers of squarefree monomial ideals are indeed rational powers themselves. Using the connection with symbolic powers techniques, we use splittings to show the convergence of depths and normalized Castelnuovo-Mumford regularities. We show the convergence of Stanley depths for rational powers, and as a consequence of this we show the before-now unknown convergence of Stanley depths of integral closure powers. In addition, we show the finiteness of asymptotic associated primes, and we find that the normalized lengths of local cohomology modules converge for rational powers, and hence for symbolic powers of squarefree monomial ideals.


title: Asymptotic Degree of Random Monomial Ideals

abstract: One of the fundamental invariants connecting algebra and geometry is the degree of an ideal. In this paper we derive the probabilistic behavior of degree with respect to the versatile Erd\H{o}s-R\'enyi-type model for random monomial ideals defined in \cite{rmi}. We study the staircase structure associated to a monomial ideal, and show that in the random case the shape of the staircase diagram is approximately hyperbolic, and this behavior is robust across several random models. Since the discrete volume under this staircase is related to the summatory higher-order divisor function studied in number theory, we use this connection and our control over the shape of the staircase diagram to derive the asymptotic degree of a random monomial ideal. Another way to compute the degree of a monomial ideal is with a standard pair decomposition. This paper derives bounds on the number of standard pairs of a random monomial ideal indexed by any subset of the ring variables. The standard pairs indexed by maximal subsets give a count of degree, as well as being a more nuanced invariant of the random monomial ideal.


title: Denoising Large-Scale Image Captioning from Alt-text Data using Content Selection Models

abstract: Training large-scale image captioning (IC) models demands access to a rich and diverse set of training examples, gathered from the wild, often from noisy alt-text data. However, recent modeling approaches to IC often fall short in terms of performance in this case, because they assume a clean annotated dataset (as opposed to the noisier alt-text--based annotations), and employ an end-to-end generation approach, which often lacks both controllability and interpretability. We address these problems by breaking down the task into two simpler, more controllable tasks -- skeleton prediction and skeleton-based caption generation. Specifically, we show that selecting content words as skeletons} helps in generating improved and denoised captions when leveraging rich yet noisy alt-text--based uncurated datasets. We also show that the predicted English skeletons can be further cross-lingually leveraged to generate non-English captions, and present experimental results covering caption generation in French, Italian, German, Spanish and Hindi. We also show that skeleton-based prediction allows for better control of certain caption properties, such as length, content, and gender expression, providing a handle to perform human-in-the-loop semi-automatic corrections.


title: A First Step Towards Distribution Invariant Regression Metrics

abstract: Regression evaluation has been performed for decades. Some metrics have been identified to be robust against shifting and scaling of the data but considering the different distributions of data is much more difficult to address (imbalance problem) even though it largely impacts the comparability between evaluations on different datasets. In classification, it has been stated repeatedly that performance metrics like the F-Measure and Accuracy are highly dependent on the class distribution and that comparisons between different datasets with different distributions are impossible. We show that the same problem exists in regression. The distribution of odometry parameters in robotic applications can for example largely vary between different recording sessions. Here, we need regression algorithms that either perform equally well for all function values, or that focus on certain boundary regions like high speed. This has to be reflected in the evaluation metric. We propose the modification of established regression metrics by weighting with the inverse distribution of function values $Y$ or the samples $X$ using an automatically tuned Gaussian kernel density estimator. We show on synthetic and robotic data in reproducible experiments that classical metrics behave wrongly, whereas our new metrics are less sensitive to changing distributions, especially when correcting by the marginal distribution in $X$. Our new evaluation concept enables the comparison of results between different datasets with different distributions. Furthermore, it can reveal overfitting of a regression algorithm to overrepresented target values. As an outcome, non-overfitting regression algorithms will be more likely chosen due to our corrected metrics.


title: Searching for the Kardar-Parisi-Zhang phase in microcavity polaritons

abstract: Recent approximate analytical work has suggested that, at certain values of the external pump, the optical parametric oscillator (OPO) regime of microcavity polaritons may provide a long sought realisation of Kardar-Parisi-Zhang (KPZ) physics in 2D. Here, by solving the full microscopic model numerically using the truncated Wigner method, we prove that this predicted KPZ phase for OPO is robust against the appearance of vortices or other effects. For those pump strengths, spatial correlations in the direction perpendicular to the pump, and the distribution of phase fluctuations, match closely to the forms characteristic of the KPZ universality. This strongly indicates the viability of observing KPZ behaviour in future polariton OPO experiments.


title: Filled Julia and Mandelbrot Sets for Dynamics over the Normed Real Nonassociative Algebras

abstract: In this paper we introduce the notion of dynamical systems over the class of the normed real nonassociative algebras not necessarily finite-dimensional, generalize the classical filled Julia and Mandelbrot sets over the complex numbers, investigate their orbits and make a topological analysis. Applications of the obtained results are made.


title: Influence of acceleration on multi-body entangled quantum states

abstract: We study the influence of acceleration on the twin-Fock state which is a class of specific multibody entangled quantum state and was already realized experimentally with high precision and sensitivity. We show that the multi-body quantum entanglement can be increased with the acceleration, consistent with the "anti-Unruh effect" in reference to the counterintuitive cooling previously pointed out for an accelerated detector coupled to the vacuum. In particular, this kind of entanglement increase can lead to the improvement of the phase sensitivity, which provides a way to test the anti-Unruh effect in the future experiments.


title: Discrete-to-continuum convergence of charged particles in 1D with annihilation

abstract: We consider a system of charged particles moving on the real line driven by electrostatic interactions. Since we consider charges of both signs, collisions might occur in finite time. Upon collision, some of the colliding particles are effectively removed from the system (annihilation). The two applications we have in mind are vortices and dislocations in metals. In this paper we reach two goals. First, we develop a rigorous solution concept for the interacting particle system with annihilation. The main innovation here is to provide a careful management of the annihilation of groups of more than two particles, and we show that the definition is consistent by proving existence, uniqueness, and continuous dependence on initial data. The proof relies on a detailed analysis of ODE trajectories close to collision, and a reparametrization of vectors in terms of the moments of their elements. Secondly, we pass to the many-particle limit (discrete-to-continuum), and recover the expected limiting equation for the particle density. Due to the singular interactions and the annihilation rule, standard proof techniques of discrete-to-continuum limits do not apply. In particular, the framework of measures seems unfit. Instead, we use the one-dimensional feature that both the particle system and the limiting PDE can be characterized in terms of Hamilton--Jacobi equations. While our proof follows a standard limit procedure for such equations, the novelty with respect to existing results lies in allowing for stronger singularities in the particle system by exploiting the freedom of choice in the definition of viscosity solutions.


title: Strangeness-changing Rates and Hyperonic Bulk Viscosity in Neutron Star Mergers

abstract: In this paper we present a computation of the rates of strangeness-changing processes and the resultant bulk viscosity in matter at the densities and temperatures typical of neutron star mergers. To deal with the high temperature in this environment we go beyond the Fermi surface approximation in our rate calculations and numerically evaluate the full phase space integral. We include processes where quarks move between baryons via meson exchange: these have generally been omitted in previous analyses but provide the dominant contribution to the rates of strangeness-changing processes and the bulk viscosity. The calculation of these rates is an essential step towards any calculation of dissipation mechanisms in hyperonic matter in mergers. As one application, we calculate the dissipation times for density oscillations at the frequencies seen in merger simulations. We find that hyperon bulk viscosity for temperatures in the MeV regime can probably be neglected in this context, but becomes highly relevant for keV-range temperatures.


title: Sequential Convex Programming For Non-Linear Stochastic Optimal Control

abstract: This work introduces a sequential convex programming framework for non-linear, finite-dimensional stochastic optimal control, where uncertainties are modeled by a multidimensional Wiener process. We prove that any accumulation point of the sequence of iterates generated by sequential convex programming is a candidate locally-optimal solution for the original problem in the sense of the stochastic Pontryagin Maximum Principle. Moreover, we provide sufficient conditions for the existence of at least one such accumulation point. We then leverage these properties to design a practical numerical method for solving non-linear stochastic optimal control problems based on a deterministic transcription of stochastic sequential convex programming.


title: TRec: Sequential Recommender Based On Latent Item Trend Information

abstract: Recommendation system plays an important role in online web applications. Sequential recommender further models user short-term preference through exploiting information from latest user-item interaction history. Most of the sequential recommendation methods neglect the importance of ever-changing item popularity. We propose the model from the intuition that items with most user interactions may be popular in the past but could go out of fashion in recent days. To this end, this paper proposes a novel sequential recommendation approach dubbed TRec, TRec learns item trend information from implicit user interaction history and incorporates item trend information into next item recommendation tasks. Then a self-attention mechanism is used to learn better node representation. Our model is trained via pairwise rank-based optimization. We conduct extensive experiments with seven baseline methods on four benchmark datasets, The empirical result shows our approach outperforms other stateof-the-art methods while maintains a superiorly low runtime cost. Our study demonstrates the importance of item trend information in recommendation system designs, and our method also possesses great efficiency which enables it to be practical in real-world scenarios.


title: STEP-GAN: A Step-by-Step Training for Multi Generator GANs with application to Cyber Security in Power Systems

abstract: In this study, we introduce a novel unsupervised countermeasure for smart grid power systems, based on generative adversarial networks (GANs). Given the pivotal role of smart grid systems (SGSs) in urban life, their security is of particular importance. In recent years, however, advances in the field of machine learning, have raised concerns about cyber attacks on these systems. Power systems, among the most important components of urban infrastructure, have, for example, been widely attacked by adversaries. Attackers disrupt power systems using false data injection attacks (FDIA), resulting in a breach of availability, integrity, or confidential principles of the system. Our model simulates possible attacks on power systems using multiple generators in a step-by-step interaction with a discriminator in the training phase. As a consequence, our system is robust to unseen attacks. Moreover, the proposed model considerably reduces the well-known mode collapse problem of GAN-based models. Our method is general and it can be potentially employed in a wide range of one of one-class classification tasks. The proposed model has low computational complexity and outperforms baseline systems about 14% and 41% in terms of accuracy on the highly imbalanced publicly available industrial control system (ICS) cyber attack power system dataset.


title: Symmetric Ideal Magnetofluidostatic Equilibria with Non-Vanishing Pressure Gradients in Asymmetric Confinement Vessels

abstract: We study the possibility of constructing steady magnetic fields satisfying the force balance equation of ideal magnetohydrodynamics with tangential boundary conditions in asymmetric confinement vessels, i.e. bounded regions that are not invariant under continuous Euclidean isometries (translations, rotations, or their combination). This problem is often encountered in the design of next-generation fusion reactors. We show that such configurations are possible if one relaxes the standard assumption that the vessel boundary corresponds to a pressure isosurface. We exhibit a smooth solution that possesses an Euclidean symmetry and yet solves the boundary value problem in an asymmetric ellipsoidal domain while sustaining a non-vanishing pressure gradient. This result provides a definitive answer to the problem of existence of regular ideal magnetofluidostatic equilibria in asymmetric bounded domains. The question remains open whether regular asymmetric solutions of the boundary value problem exist.


title: An Argumentation-based Approach for Identifying and Dealing with Incompatibilities among Procedural Goals

abstract: During the first step of practical reasoning, i.e. deliberation, an intelligent agent generates a set of pursuable goals and then selects which of them he commits to achieve. An intelligent agent may in general generate multiple pursuable goals, which may be incompatible among them. In this paper, we focus on the definition, identification and resolution of these incompatibilities. The suggested approach considers the three forms of incompatibility introduced by Castelfranchi and Paglieri, namely the terminal incompatibility, the instrumental or resources incompatibility and the superfluity. We characterise computationally these forms of incompatibility by means of arguments that represent the plans that allow an agent to achieve his goals. Thus, the incompatibility among goals is defined based on the conflicts among their plans, which are represented by means of attacks in an argumentation framework. We also work on the problem of goals selection; we propose to use abstract argumentation theory to deal with this problem, i.e. by applying argumentation semantics. We use a modified version of the "cleaner world" scenario in order to illustrate the performance of our proposal.


title: Wheeler-DeWitt equation rejects quantum effects of grown-up universes as a candidate for dark energy

abstract: In this paper, we study the changes of quantum effects of a growing universe by using Wheeler-DeWitt equation (WDWE) together with de Broglie-Bohm quantum trajectory approach. From WDWE, we obtain the quantum modified Friedmann equations which have additional terms called quantum potential compared to standard Friedmann equations. The quantum potential governs the behavior of the early universe, providing energy for inflation, while it decreases rapidly as the universe grows. The quantum potential of the grown-up universe is much smaller than that required for accelerating expansion. This indicates that quantum effects of our universe cannot be treated as a candidate for dark energy.


title: SONYC-UST-V2: An Urban Sound Tagging Dataset with Spatiotemporal Context

abstract: We present SONYC-UST-V2, a dataset for urban sound tagging with spatiotemporal information. This dataset is aimed for the development and evaluation of machine listening systems for real-world urban noise monitoring. While datasets of urban recordings are available, this dataset provides the opportunity to investigate how spatiotemporal metadata can aid in the prediction of urban sound tags. SONYC-UST-V2 consists of 18510 audio recordings from the "Sounds of New York City" (SONYC) acoustic sensor network, including the timestamp of audio acquisition and location of the sensor. The dataset contains annotations by volunteers from the Zooniverse citizen science platform, as well as a two-stage verification with our team. In this article, we describe our data collection procedure and propose evaluation metrics for multilabel classification of urban sound tags. We report the results of a simple baseline model that exploits spatiotemporal information.


title: Modeling networks of probabilistic memristors in SPICE

abstract: Efficient simulation of probabilistic memristors and their networks requires novel modeling approaches. One major departure from the conventional memristor modeling is based on a master equation for the occupation probabilities of network states [arXiv:2003.11011 (2020)]. In the present article, we show how to implement such master equations in SPICE - a general-purpose circuit simulation program. In the case studies, we simulate the dynamics of ac-driven probabilistic binary and multi-state memristors, and dc-driven networks of probabilistic binary and multi-state memristors. Our SPICE results are in perfect agreement with known analytical solutions. Examples of LTspice codes are included.


title: Two-dimensional vortex quantum droplets get thick

abstract: We study two-dimensional (2D) vortex quantum droplets (QDs) trapped by a thicker transverse confinement with a>1um. Under this circumstance, the Lee-Huang-Yang (LHY) term should be described by its original form in the three-dimensional (3D) configuration. Previous studies have demonstrated that stable 2D vortex QDs can be supported by a thin transverse confinement with a<<1um. In this case, the LHY term is described by a logarithm. Hence, two kinds of confinement features result in different mechanisms of the vortex QDs. The stabilities and characteristics of the vortex QDs must be re-identified. In the current system, we find that stable 2D vortex QDs can be supported with topological charge number up to at least 4. We reformulated their density profile, chemical potential and threshold norm for supporting the stable vortex QDs according to the new condition. Unlike the QDs under thin confinement, the QDs in the current system strongly repel each other because the LHY term features a higher-order repulsion than that of the thin confinement system. Moreover, elastic and inelastic collisions between two moving vortex QDs are studied throughout the paper. Two kinds of collisions can be characterized by exerting different values of related speed. The dynamics of the stable nested vortex QD, which is constructed by embedding one vortex QD with a smaller topological number into another vortex QD with a larger number of topological charge, can be supported by the system.


title: Convex co-compact representations of 3-manifold groups

abstract: A representation of a finitely generated group into the projective general linear group is called convex co-compact if it has finite kernel and its image acts convex co-compactly on a properly convex domain in real projective space. We prove that the fundamental group of a closed irreducible orientable 3-manifold can admit such a representation only when the manifold is geometric (with Euclidean, Hyperbolic, or Euclidean $\times$ Hyperbolic geometry) or when every component in the geometric decomposition is hyperbolic. In each case, we describe the structure of such examples.


title: Topological phase transitions driven by polarity change and next-nearest-neighbor hopping in skyrmion crystals

abstract: By considering the bulk-edge correspondence of the skyrmion crystal this work focused on the relation of the topological properties to the polarity ($Q_{\rm{sk}}$), next-nearest-neighbor hopping ($t'$), and exchange coupling ($J$). We found that by continually increasing polarity of the skyrmions from 1 to 2, the monopole-lattice phase and the dipole-lattice phase both span a wide range in the parameter space demonstrating topological robustness. While the next-nearest-neighbor-hopping of the electrons coexists with the nearest-neighbor hopping the flux pattern of the emergent magnetic field traversing the two-dimensional SkX is reshaped giving rise to different topological Hall effect. By increasing $t'$ from 0 to $t$ with the polarity fixed to be 1, we found Chern numbers of the electronic bands change from unity to indefinite values demonstrating a phase transition. We also considered the effect of finite $J$ and found the results obtained in the adiabatic limit hold to around $J=t$.


title: Scalarized charged black holes in the Einstein-Maxwell-Scalar theory with two U(1) fields

abstract: We investigate scalarized charged black holes in the Einstein-Maxwell-Scalar theory with two U(1) fields inspired by the $N=4$ supergravity. From the onset of the spontaneous scalarization (tachyonic instability of Reissner-Nordstr\"{o}m black hole), these black holes are classified by the number of $n=0,1,2,\cdots$, where $n=0$ is called the fundamental black hole and $n=1,2,\cdots$ denote the $n$-excited black holes. Adopting radial perturbations, we show that the $n=0$ black hole is stable against the $s(l=0)$-mode scalar perturbation, whereas the $n=1,2$ excited black holes are unstable. This implies that the $n=0$ black hole is considered as an endpoint of the Reissner-Nordstr\"{o}m black hole.


title: Scenario Forecast of Cross-border Electric Interconnection towards Renewables in South America

abstract: Cross-border Electric Interconnection towards renewables is a promising solution for electric sector under the UN 2030 sustainable development goals which is widely promoted in emerging economies. This paper comprehensively investigates state of art in renewable resources and cross-border electric interconnection in South America. Based on the raw data collected from typical countries, a long-term scenario forecast methodology is applied to estimate key indicators of electric sector in target years, comparing the prospects of active promoting cross-border Interconnections Towards Renewables (ITR) scenario with Business as Usual (BAU) scenario in South America region. Key indicators including peak load, installed capacity, investment, and generation cost are forecasted and comparative analyzed by year 2035 and 2050. The comparative data analysis shows that by promoting cross-border interconnection towards renewables in South America, renewable resources can be highly utilized for energy supply, energy matrix can be optimized balanced, economics can be obviously driven and generation cost can be greatly reduced.


title: Revisiting the top quark chromomagnetic dipole moment in the SM

abstract: We revisit the anomalous chromomagnetic dipole moment in the Standard Model and show that its triple gluon vertex contribution, with the on-shell gluon ($q^2=0$), generates an infrared divergent pole. Consequently, the chromomagnetic dipole should not be perturbatively evaluated at $q^2=0$. Focusing on this top quark anomaly, denoted as $\hat{\mu}_t(q^2)$, we compute it with the off-shell gluon with a large momentum transfer, just as the $\alpha_s(m_Z^2)$ convention scale, for both spacelike $q^2=-m_Z^2$ and timelike $q^2=m_Z^2$ cases. We found that $\hat{\mu}_t(-m_Z^2)$ $=$ $-0.0224$ $-0.000925i$ and $\hat{\mu}_t(m_Z^2)$ $=$ $-0.0133$ $-0.0267i$. Our $\mathrm{Re}\thinspace\hat{\mu}_t(-m_Z^2)$ matches well with the current experimental value $\hat{\mu}_t^\mathrm{Exp}=-0.024_{-0.009}^{+0.013}(\mathrm{stat})_{-0.011}^{+0.016}(\mathrm{syst})$, and the $\mathrm{Im}\thinspace\hat{\mu}_t(-m_Z^2)$ part is induced by flavour changing charged currents.


title: Pressure induced quenching of planar rattling in Cu$_{10}$Zn$_{2}$Sb$_{4}$S$_{13}$ studied by specific-heat and x-ray diffraction measurements

abstract: We have studied the pressure effect on the rattling of tetrahedrite Cu$_{10}$Zn$_{2}$Sb$_{4}$S$_{13\,}$(CZSS) and type-I clathrate Ba$_{8}$Ga$_{16}$Sn$_{30\,}$(BGS) by specific heat and x-ray diffraction measurements. By applying pressure $P$, the rattling energy for CZSS initially decreases and steeply increases for $P$ $\textgreater$ $1$ GPa. By contrast, the energy for BGS increases monotonically with $P$ up to 6.5 GPa. An analysis of the pressure dependent specific heat and x-ray diffraction indicates that the out-of-plane rattling of the Cu atoms in the S$_{3}$ triangle of CZSS originates from the chemical pressure, unlike the rattling of the Ba ions among off-center sites in an oversized cage of BGS. The rattling in CZSS ceases upon further increasing $P$ above 2 GPa, suggesting that Cu atoms escape away from the S$_{3}$ triangle plane.


title: Beyond Localized Graph Neural Networks: An Attributed Motif Regularization Framework

abstract: We present InfoMotif, a new semi-supervised, motif-regularized, learning framework over graphs. We overcome two key limitations of message passing in popular graph neural networks (GNNs): localization (a k-layer GNN cannot utilize features outside the k-hop neighborhood of the labeled training nodes) and over-smoothed (structurally indistinguishable) representations. We propose the concept of attributed structural roles of nodes based on their occurrence in different network motifs, independent of network proximity. Two nodes share attributed structural roles if they participate in topologically similar motif instances over co-varying sets of attributes. Further, InfoMotif achieves architecture independence by regularizing the node representations of arbitrary GNNs via mutual information maximization. Our training curriculum dynamically prioritizes multiple motifs in the learning process without relying on distributional assumptions in the underlying graph or the learning task. We integrate three state-of-the-art GNNs in our framework, to show significant gains (3-10% accuracy) across six diverse, real-world datasets. We see stronger gains for nodes with sparse training labels and diverse attributes in local neighborhood structures.


title: Information flow in political elections: a stochastic perspective

abstract: Often times, a candidate's attractiveness is directly associated with his clear ideologies and opinions on various policies and social issues. Using the ideas of stochastic differential equations and Ornstein-Uhlenbeck Process, we develop a phenomenological model to understand the effect of (un)clearly communicating a candidate's stance on policies to the voting public. We will show that, counter intuitively, there are quantifiable advantages to be vague on one's stance.


title: CounteRGAN: Generating Realistic Counterfactuals with Residual Generative Adversarial Nets

abstract: The prevalence of machine learning models in various industries has led to growing demands for model interpretability and for the ability to provide meaningful recourse to users. For example, patients hoping to improve their diagnoses or loan applicants seeking to increase their chances of approval. Counterfactuals can help in this regard by identifying input perturbations that would result in more desirable prediction outcomes. Meaningful counterfactuals should be able to achieve the desired outcome, but also be realistic, actionable, and efficient to compute. Current approaches achieve desired outcomes with moderate actionability but are severely limited in terms of realism and latency. To tackle these limitations, we apply Generative Adversarial Nets (GANs) toward counterfactual search. We also introduce a novel Residual GAN (RGAN) that helps to improve counterfactual realism and actionability compared to regular GANs. The proposed CounteRGAN method utilizes an RGAN and a target classifier to produce counterfactuals capable of providing meaningful recourse. Evaluations on two popular datasets highlight how the CounteRGAN is able to overcome the limitations of existing methods, including latency improvements of >50x to >90,000x, making meaningful recourse available in real-time and applicable to a wide range of domains.


title: Isotopic equilibrium constants for very low-density and low-temperature nuclear matter

abstract: Yields of equatorially emitted light isotopes, $1\le Z\le 14$, observed in ternary fission in the reaction $^{241}$Pu($n_{\rm th}$,f) are employed to determine apparent chemical equilibrium constants for low-temperature and low-density nuclear matter. The degree of liberation and role of medium modifications are probed through a comparison of experimentally derived reaction quotients with equilibrium constants calculated using a relativistic mean-field model employing a universal medium modification correction for the attractive $\sigma$ meson coupling. The results of these comparisons indicate that equilibrium is achieved for the lighter ternary fission isotopes. For the heavier isotopes experimental reaction quotients are well below calculated equilibrium constants. This is attributed to a dynamical limitation reflecting insufficient time for full equilibrium to develop. The role of medium effects leading to yield reductions is discussed as is the apparent enhancement of yields for $^8$He and other very neutron rich exotic nuclei.


title: Limiting Superluminal Neutrino Velocity and Lorentz Invariance Violation by Neutrino Emission from the Blazar TXS 0506+056

abstract: The detection of high-energy neutrino coincident with the blazar TXS 0506+056 provides a unique opportunity to test Lorentz invariance violation (LIV) in the neutrino sector. Thanks to the precisely measured redshift, i.e., $z=0.3365$, the comoving distance of the neutrino source is determined. In this work, we obtain and discuss the constraints on the superluminal neutrino velocity $\delta_\nu$ and the LIV by considering the energy loss of superluminal neutrino during propagation. Given superluminal electron velocity ($\delta_e \ge 0$), a very stringent constraint on superluminal neutrino velocity can be reached, i.e., $\delta_\nu \lesssim 1.3\times 10^{-18}$, corresponding to the quantum gravity (QG) scale $M_{\rm QG,1} \gtrsim 5.7 \times 10^{3} M_{\rm Pl}$ and $M_{\rm QG,2} \gtrsim 9.3 \times 10^{-6} M_{\rm Pl}$ for linear (quadratic) LIV, which are $\sim 12$ orders of magnitude tighter for linear LIV and $\sim 9$ orders tighter for quadratic LIV compared to the time-of-flight constraint from MeV neutrinos of SN 1987A. While given the subluminal electron velocity, a weaker constraint on the superluminal neutrino velocity is obtained, i.e., $\delta_\nu \lesssim 8 \times 10^{-17}$, which is consistent with the conclusions of previous works. We also study the neutrino detection probability due to the distortion of neutrino spectral shape during propagation, which gives slightly weaker constraints than above by a factor of $\sim2$.


title: A Short Proof of the Rank Formula for Inclusion Matrices using the Representation Theory of the Symmetric Group

abstract: We present a new proof of the well known formula for the rank of the inclusion matrix by constructing a $k\mathcal{S}_n$-module spanned by the columns of this matrix and calculating its dimension.


title: A Bayesian hierarchical model to estimate land surface phenology parameters with harmonized Landsat 8 and Sentinel-2 images

abstract: We develop a Bayesian Land Surface Phenology (LSP) model and examine its performance using Enhanced Vegetation Index (EVI) observations derived from the Harmonized Landsat Sentinel-2 (HLS) dataset. Building on previous work, we propose a double logistic function that, once couched within a Bayesian model, yields posterior distributions for all LSP parameters. We assess the efficacy of the Normal, Truncated Normal, and Beta likelihoods to deliver robust LSP parameter estimates. Two case studies are presented and used to explore aspects of the proposed model. The first, conducted over forested pixels within a HLS tile, explores choice of likelihood and space-time varying HLS data availability for long-term average LSP parameter point and uncertainty estimation. The second, conducted on a small area of interest within the HLS tile on an annual time-step, further examines the impact of sample size and choice of likelihood on LSP parameter estimates. Results indicate that while the Truncated Normal and Beta likelihoods are theoretically preferable when the vegetation index is bounded, all three likelihoods performed similarly when the number of index observations is sufficiently large and values are not near the index bounds. Both case studies demonstrate how pixel-level LSP parameter posterior distributions can be used to propagate uncertainty through subsequent analysis. As a companion to this article, we provide an open-source \R package \pkg{rsBayes} and supplementary data and code used to reproduce the analysis results. The proposed model specification and software implementation delivers computationally efficient, statistically robust, and inferentially rich LSP parameter posterior distributions at the pixel-level across massive raster time series datasets.


title: Transfer Learning of Graph Neural Networks with Ego-graph Information Maximization

abstract: Graph neural networks (GNNs) have achieved superior performance in various applications, but training dedicated GNNs can be costly for large-scale graphs. Some recent work started to study the pre-training of GNNs. However, none of them provide theoretical insights into the design of their frameworks, or clear requirements and guarantees towards their transferability. In this work, we establish a theoretically grounded and practically useful framework for the transfer learning of GNNs. Firstly, we propose a novel view towards the essential graph information and advocate the capturing of it as the goal of transferable GNN training, which motivates the design of EGI (Ego-Graph Information maximization) to analytically achieve this goal. Secondly, when node features are structure-relevant, we conduct an analysis of EGI transferability regarding the difference between the local graph Laplacians of the source and target graphs. We conduct controlled synthetic experiments to directly justify our theoretical conclusions. Comprehensive experiments on two real-world network datasets show consistent results in the analyzed setting of direct-transfering, while those on large-scale knowledge graphs show promising results in the more practical setting of transfering with fine-tuning.