title: Unsupervised Video Decomposition using Spatio-temporal Iterative Inference

abstract: Unsupervised multi-object scene decomposition is a fast-emerging problem in representation learning. Despite significant progress in static scenes, such models are unable to leverage important dynamic cues present in video. We propose a novel spatio-temporal iterative inference framework that is powerful enough to jointly model complex multi-object representations and explicit temporal dependencies between latent variables across frames. This is achieved by leveraging 2D-LSTM, temporally conditioned inference and generation within the iterative amortized inference for posterior refinement. Our method improves the overall quality of decompositions, encodes information about the objects' dynamics, and can be used to predict trajectories of each object separately. Additionally, we show that our model has a high accuracy even without color information. We demonstrate the decomposition, segmentation, and prediction capabilities of our model and show that it outperforms the state-of-the-art on several benchmark datasets, one of which was curated for this work and will be made publicly available.


title: Photon-mediated entanglement scheme between a ZnO semiconductor defect and a trapped Yb ion

abstract: We propose an optical scheme to generate an entangled state between a trapped ion and a solid state donor qubit through which-path erasure of identical photons emitted from the two systems. The proposed scheme leverages the similar transition frequencies between In donor bound excitons in ZnO and the $^2P_{1/2}$ to $^2S_{1/2}$ transition in Yb$^+$. The lifetime of the relevant ionic state is longer than that of the ZnO system by a factor of 6, leading to a mismatch in the temporal profiles of emitted photons. A detuned cavity-assisted Raman scheme weakly excites the donor with a shaped laser pulse to generate photons with 0.99 temporal overlap to the Yb$^+$ emission and partially shift the emission of the defect toward the Yb$^+$ transition. The remaining photon shift is accomplished via the dc Stark effect. We show that an entanglement rate of 21 kHz and entanglement fidelity of 94 % can be attained using a weak excitation scheme with reasonable parameters.


title: Competing orders at higher-order Van Hove points

abstract: Van Hove points are special points in the energy dispersion, where the density of states exhibits analytic singularities. When a Van Hove point is close to the Fermi level, tendencies towards density wave orders, Pomeranchuk orders, and superconductivity can all be enhanced, often in more than one channel, leading to a competition between different orders and unconventional ground states. Here we consider the effects from higher-order Van Hove points, around which the dispersion is flatter than near a conventional Van Hove point, and the density of states has a power-law divergence. We argue that such points are present in intercalated graphene and other materials. We use an effective low-energy model for electrons near higher-order Van Hove points and analyze the competition between different ordering tendencies using an unbiased renormalization group approach. For purely repulsive interactions, we find that two key competitors are ferromagnetism and chiral superconductivity. For a small attractive exchange interaction, we find a new type of spin Pomeranchuk order, in which the spin order parameter winds around the Fermi surface. The supermetal state, predicted for a single higher-order Van Hove point, is an unstable fixed point in our case.


title: Precision measurements of radar transverse scattering speeds from meteor phase characteristics

abstract: We describe an improved technique for using the backscattered phase from meteor radar echo measurements just prior to the specular point ($t_{0}$) to calculate meteor speeds and their uncertainty. Our method, which builds on earlier work of Cervera et al (1997), scans possible speeds in the Fresnel distance - time domain with a dynamic, sliding window and derives a best-speed estimate from the resultant speed distribution. We test the performance of our method, called pre-$t_{0}$ speeds by sliding-slopes technique (PSSST), on transverse scattered meteor echoes observed by the Middle Atmosphere Alomar Radar System (MAARSY) and the Canadian Meteor Orbit Radar (CMOR), and compare the results to time-of-flight and Fresnel transform speed estimates. Our novel technique is shown to produce good results when compared to both model and speed measurements using other techniques. We show that our speed precision is $\pm$5$\%$ at speeds less than 40 km/s and we find that more than 90$\%$ of all CMOR multi-station echoes have PSSST solutions. For CMOR data, PSSST is robust against the selection of critical phase value and poor phase unwrapping. Pick errors of up to $\pm$6 pulses for meteor speeds less than about 50 km/s produce errors of less than $\pm$5$\%$ of the meteoroid speed. In addition, the width of the PSSST speed Kernel density estimate (KDE) is used as a natural measure of uncertainty that captures both noise and $t_0$ pick uncertainties.


title: Detection of a Low-frequency Cosmic Radio Transient Using Two LWA Stations

abstract: We report the detection of a potential cosmic radio transient source using the two stations of the Long Wavelength Array. The transient was detected on 18 October 2017 08:47 UTC near the celestial equator while reducing 10,240 hours of archival all-sky images from the LWA1 and LWA-SV stations. The detected transient at 34 MHz has a duration of 15 - 20 seconds and a flux density of 842 +/- 116 Jy at LWA1 and 830 +/- 92 Jy at LWA-SV. The transient source has not repeated, and its nature is not well understood. The Pan-STARRS optical telescope has detected a supernova that occurred on the edge of the position error circle of the transient on the same day.


title: Identification and Formal Privacy Guarantees

abstract: Empirical economic research crucially relies on highly sensitive individual datasets. At the same time, increasing availability of public individual-level data makes it possible for adversaries to potentially de-identify anonymized records in sensitive research datasets. Most commonly accepted formal definition of an individual non-disclosure guarantee is referred to as differential privacy. It restricts the interaction of researchers with the data by allowing them to issue queries to the data. The differential privacy mechanism then replaces the actual outcome of the query with a randomised outcome. The impact of differential privacy on the identification of empirical economic models and on the performance of estimators in nonlinear empirical Econometric models has not been sufficiently studied. Since privacy protection mechanisms are inherently finite-sample procedures, we define the notion of identifiability of the parameter of interest under differential privacy as a property of the limit of experiments. It is naturally characterized by the concepts from the random sets theory. We show that particular instances of regression discontinuity design may be problematic for inference with differential privacy as parameters turn out to be neither point nor partially identified. The set of differentially private estimators converges weakly to a random set. Our analysis suggests that many other estimators that rely on nuisance parameters may have similar properties with the requirement of differential privacy. We show that identification becomes possible if the target parameter can be deterministically located within the random set. In that case, a full exploration of the random set of the weak limits of differentially private estimators can allow the data curator to select a sequence of instances of differentially private estimators converging to the target parameter in probability.


title: APX-Hardness and Approximation for the k-Burning Number Problem

abstract: Consider an information diffusion process on a graph $G$ that starts with $k>0$ burnt vertices, and at each subsequent step, burns the neighbors of the currently burnt vertices, as well as $k$ other unburnt vertices. The \emph{$k$-burning number} of $G$ is the minimum number of steps $b_k(G)$ such that all the vertices can be burned within $b_k(G)$ steps. Note that the last step may have smaller than $k$ unburnt vertices available, where all of them are burned. The $1$-burning number coincides with the well-known burning number problem, which was proposed to model the spread of social contagion. The generalization to $k$-burning number allows us to examine different worst-case contagion scenarios by varying the spread factor $k$. In this paper we prove that computing $k$-burning number is APX-hard, for any fixed constant $k$. We then give an $O((n+m)\log n)$-time 3-approximation algorithm for computing $k$-burning number, for any $k\ge 1$, where $n$ and $m$ are the number of vertices and edges, respectively. Finally, we show that even if the burning sources are given as an input, computing a burning sequence itself is an NP-hard problem.


title: Stochastic Approximation Algorithm for Estimating Mixing Distribution for Dependent Observations

abstract: Estimating the mixing density of a mixture distribution remains an interesting problem in statistics literature. Using a stochastic approximation method, Newton and Zhang (1999) introduced a fast recursive algorithm for estimating the mixing density of a mixture. Under suitably chosen weights the stochastic approximation estimator converges to the true solution. In Tokdar et. al. (2009) the consistency of this recursive estimation method was established. However, the proof of consistency of the resulting estimator used independence among observations as an assumption. Here, we extend the investigation of performance of Newton's algorithm to several dependent scenarios. We prove that the original algorithm under certain conditions remains consistent even when the observations are arising from a weakly dependent stationary process with the target mixture as the marginal density. We show consistency under a decay condition on the dependence among observations when the dependence is characterized by a quantity similar to mutual information between the observations.


title: Time keeping and searching for new physics using metastable states of Cu, Ag and Au

abstract: We study the prospects of using the electric quadrupole transitions from the ground states of Cu, Ag and Au to the metastable state $^2{\rm D}_{5/2}$ as clock transitions in optical lattice clocks. We calculate lifetimes, transition rates, systematic shifts, and demonstrate that the fractional uncertainty of the clocks can be similar to what is achieved in the best current optical clocks. The use of these proposed clocks for the search of new physics, such as time variation of the fine structure constant, search for low-mass scalar dark matter, violation of Local Position Invariance and violation of Lorenz Invariance is discussed.


title: Towards Feynman rules for conformal blocks

abstract: We conjecture a simple set of "Feynman rules" for constructing $n$-point global conformal blocks in any channel in $d$ spacetime dimensions, for external and exchanged scalar operators for arbitrary $n$ and $d$. The vertex factors are given in terms of Lauricella hypergeometric functions of one, two or three variables, and the Feynman rules furnish an explicit power-series expansion in powers of cross-ratios. These rules are conjectured based on previously known results in the literature, which include four-, five- and six-point examples as well as the $n$-point comb channel blocks. We prove these rules for all previously known cases, as well as for a seven-point block in a new topology and the even-point blocks in the "OPE channel." The proof relies on holographic methods, notably the Feynman rules for Mellin amplitudes of tree-level AdS diagrams in a scalar effective field theory, and is easily applicable to any particular choice of a conformal block.


title: Monitoring of process and risk-adjusted medical outcomes using a multi-stage MEWMA chart

abstract: Most statistical process control programmes in healthcare focus on surveillance of outcomes at the final stage of a procedure, such as mortality or failure rates. Such an approach ignores the multi-stage nature of these procedures, in which a patient progresses through several stages prior to the final stage. In this paper, we develop a multi-stage control chart based on a multivariate exponentially weighted moving average (EWMA) test statistic derived from score equations. This allows simultaneous monitoring of all intermediate and final stage outcomes of a healthcare process, with adjustment for underlying patient risk factors and dependence between outcome variables. Use of the EWMA test statistics allows quick detection of small gradual changes in any part of the process. Three advantages of the approach are: better understanding of how outcomes at different stages relate to each other, explicit monitoring of upstream stage outcomes may help curtail trends that lead to poorer end-stage outcomes and understanding the impact of each stage can help determine the most effective allocation of quality improvement resources. Simulations are performed to test the control charts under various types of hypothesised shifts, and the results are summarised using out-of-control average run lengths.


title: Cascaded Convolutional Neural Networks with Perceptual Loss for Low Dose CT Denoising

abstract: Low Dose CT Denoising research aims to reduce the risks of radiation exposure to patients. Recently researchers have used deep learning to denoise low dose CT images with promising results. However, approaches that use mean-squared-error (MSE) tend to over smooth the image resulting in loss of fine structural details in low contrast regions of the image. These regions are often crucial for diagnosis and must be preserved in order for Low dose CT to be used effectively in practice. In this work we use a cascade of two neural networks, the first of which aims to reconstruct normal dose CT from low dose CT by minimizing perceptual loss, and the second which predicts the difference between the ground truth and prediction from the perceptual loss network. We show that our method outperforms related works and more effectively reconstructs fine structural details in low contrast regions of the image.


title: Hadron production in elementary nucleon-nucleon reactions from low to ultra-relativistic energies

abstract: We study the hadron production in $p+p$, $p+n$ and $n+n$ reactions within the microscopic Parton-Hadron-Dynamics (PHSD) transport approach in comparison to PYTHIA 8.2. We discuss the details of the "PHSD tune" of the Lund string model (realized by event generators FRITIOF and PYTHIA) in the vacuum (as in $N+N$ collisions) as well as its in-medium modifications relevant for heavy-ion collisions where a hot and dense matter is produced. We compare the results of PHSD and PYTHIA 8.2 (default version) for the excitation function of hadron multiplicities as well as differential rapidity $y$, transverse momentum $p_T$ and $x_F$ distributions in $p+p$, $p+n$ and $n+n$ reactions with the existing experimental data in the energy range $\sqrt{s_{NN}} = 2.7 - 7000$ GeV. We discuss the production mechanisms of hadrons and the role of final state interactions (FSI) due to the hadronic rescattering. We also show the influence of the possible quark-gluon plasma (QGP) formation on hadronic observables in $p+p$ collisions at LHC energies. We stress the importance of developing a reliable event generator for elementary reactions from low to ultra-relativistic energies in view of actual and upcoming heavy-ion experiments.


title: Propagation control of octahedral tilt in SrRuO3 via artificial heterostructuring

abstract: Bonding geometry engineering of metal-oxygen octahedra is a facile way of tailoring various functional properties of transition metal oxides. Several approaches, including epitaxial strain, thickness, and stoichiometry control, have been proposed to efficiently tune the rotation and tilting of the octahedra, but these approaches are inevitably accompanied by unnecessary structural modifications such as changes in thin-film lattice parameters. In this study, we propose a method to selectively engineer the octahedral bonding geometries, while maintaining other parameters that might implicitly influence the functional properties. A concept of octahedral tilt propagation engineering has been developed using atomically designed SrRuO3/SrTiO3 superlattices. In particular, the propagation of RuO6 octahedral tilting within the SrRuO3 layers having identical thicknesses was systematically controlled by varying the thickness of adjacent SrTiO3 layers. This led to a substantial modification in the electromagnetic properties of the SrRuO3 layer, significantly enhancing the magnetic moment of Ru. Our approach provides a method to selectively manipulate the bonding geometry of strongly correlated oxides, thereby enabling a better understanding and greater controllability of their functional properties.


title: Getting to the Bottom of Noether's Theorem

abstract: We examine the assumptions behind Noether's theorem connecting symmetries and conservation laws. To compare classical and quantum versions of this theorem, we take an algebraic approach. In both classical and quantum mechanics, observables are naturally elements of a Jordan algebra, while generators of one-parameter groups of transformations are naturally elements of a Lie algebra. Noether's theorem holds whenever we can map observables to generators in such a way that each observable generates a one-parameter group that preserves itself. In ordinary complex quantum mechanics this mapping is multiplication by $\sqrt{-1}$. In the more general framework of unital JB-algebras, Alfsen and Shultz call such a mapping a "dynamical correspondence", and show its presence allows us to identify the unital JB-algebra with the self-adjoint part of a complex C*-algebra. However, to prove their result, they impose a second, more obscure, condition on the dynamical correspondence. We show this expresses a relation between quantum and statistical mechanics, closely connected to the principle that "inverse temperature is imaginary time".


title: The size of oscillations in the Goldbach conjecture

abstract: Let $R(n) = \sum_{a+b=n} \Lambda(a)\Lambda(b)$, where $\Lambda(\cdot)$ is the von Mangoldt function. The function $R(n)$ is often studied in connection with Goldbach's conjecture. On the Riemann hypothesis (RH) it is known that $\sum_{n\leq x} R(n) = x^2/2 - 4x^{3/2} G(x) + O(x^{1+\epsilon})$, where $G(x)=\Re \sum_{\gamma>0} \frac{x^{i\gamma}}{(\frac{1}{2} + i\gamma)(\frac{3}{2} + i\gamma)}$ and the sum is over the ordinates of the nontrivial zeros of the Riemann zeta function in the upper half-plane. We prove (on RH) that each of the inequalities $G(x) < -0.02093$ and $G(x)> 0.02092$ hold infinitely often, and establish improved bounds under an assumption of linearly independence for zeros of the zeta function. We also show that the bounds we obtain are very close to optimal.


title: Felix Klein's "Uber die Integralform der Erhaltungss\"atze und die Theorie der r\"aumlich-geschlossenen Welt": an English translation

abstract: We present an English translation of a third 1918 paper by Felix Klein which follows up on his earlier work.


title: Graph Optimal Transport for Cross-Domain Alignment

abstract: Cross-domain alignment between two sets of entities (e.g., objects in an image, words in a sentence) is fundamental to both computer vision and natural language processing. Existing methods mainly focus on designing advanced attention mechanisms to simulate soft alignment, with no training signals to explicitly encourage alignment. The learned attention matrices are also dense and lacks interpretability. We propose Graph Optimal Transport (GOT), a principled framework that germinates from recent advances in Optimal Transport (OT). In GOT, cross-domain alignment is formulated as a graph matching problem, by representing entities into a dynamically-constructed graph. Two types of OT distances are considered: (i) Wasserstein distance (WD) for node (entity) matching; and (ii) Gromov-Wasserstein distance (GWD) for edge (structure) matching. Both WD and GWD can be incorporated into existing neural network models, effectively acting as a drop-in regularizer. The inferred transport plan also yields sparse and self-normalized alignment, enhancing the interpretability of the learned model. Experiments show consistent outperformance of GOT over baselines across a wide range of tasks, including image-text retrieval, visual question answering, image captioning, machine translation, and text summarization.


title: Point Proposal Network for Reconstructing 3D Particle Endpoints with Sub-Pixel Precision in Liquid Argon Time Projection Chambers

abstract: Liquid Argon Time Projection Chambers (LArTPC) are particle imaging detectors recording 2D or 3D images of trajectories of charged particles. Identifying points of interest in these images, namely the initial and terminal points of track-like particle trajectories such as muons and protons, and the initial points of electromagnetic shower-like particle trajectories such as electrons and gamma rays, is a crucial step of identifying and analyzing these particles and impacts the inference of physics signals such as neutrino interaction. The Point Proposal Network is designed to discover these specific points of interest. The algorithm predicts with a sub-voxel precision their spatial location, and also determines the category of the identified points of interest. Using as a benchmark the PILArNet public LArTPC data sample in which the voxel resolution is 3mm/voxel, our algorithm successfully predicted 96.8% and 97.8% of 3D points within a distance of 3 and 10~voxels from the provided true point locations respectively. For the predicted 3D points within 3 voxels of the closest true point locations, the median distance is found to be 0.25 voxels, achieving the sub-voxel level precision. In addition, we report our analysis of the mistakes where our algorithm prediction differs from the provided true point positions by more than 10~voxels. Among 50 mistakes visually scanned, 25 were due to the definition of true position location, 15 were legitimate mistakes where a physicist cannot visually disagree with the algorithm's prediction, and 10 were genuine mistakes that we wish to improve in the future. Further, using these predicted points, we demonstrate a simple algorithm to cluster 3D voxels into individual track-like particle trajectories with a clustering efficiency, purity, and Adjusted Rand Index of 96%, 93%, and 91% respectively.


title: Towards an automated repository for indexing, analysis and characterization of municipal e-government websites in Mexico

abstract: This article addresses a problem in the electronic government discipline with special interest in Mexico: the need for a concentrated and updated information source about municipal e-government websites. One reason for this is the lack of a complete and updated database containing the electronic addresses (web domain names) of the municipal governments having a website. Due to diverse causes, not all the Mexican municipalities have one, and a number of those having it do not present information corresponding to the current governments but, instead, to other previous ones. The scarce official lists of municipal websites are not updated with the sufficient frequency, and manually determining which municipalities have an operating and valid website in a given moment is a time-consuming process. Besides, website contents do not always comply with legal requirements and are considerably heterogeneous. In turn, the evolution development level of municipal websites is valuable information that can be harnessed for diverse theoretical and practical purposes in the public administration field. Obtaining all these pieces of information requires website content analysis. Therefore, this article investigates the need for and the feasibility to automate implementation and updating of a digital repository to perform diverse analyses of these websites. Its technological feasibility is addressed by means of a literature review about web scraping and by proposing a preliminary manual methodology. This takes into account known, proven, techniques and software tools for web crawling and scraping. No new techniques for crawling or scraping are proposed because the existing ones satisfy the current needs. Finally, software requirements are specified in order to automate the creation, updating, indexing, and analyses of the repository.


title: Superfluids in Polymer Quantum Mechanics

abstract: In this work, we analyze the corrections obtained on a homogeneous one-dimensional Bose gas within the high densities limit by means of the polymer quantization scheme. Thus, starting from the Bogoliubov formalism, we analyze the ground expectation value of the polymer momentum operator in terms of semiclassical states, in order to obtain an analytic expression for the ground state energy of the N-body system, which allows us to solve the pathological behavior commonly associated with the one-dimensional Bose-Einstein condensation through the introduction of finite size effects characterized by the contribution of the polymer corrections. We also discuss the speed of sound in our polymer version of the Bose gas and the corresponding relative shift induced by the introduction of a minimum length parameter. Finally, by considering the idea that the Bose-Einstein condensation phenomenon is closely related to that of superfluidity, we investigate the emergent superfluid behavior in our polymer model by implementing an appropriate Landau's criterion. In this case, we are able to consequently analyze the changes in the critical velocity which defines the limit between the superfluid-condensate regions, thus deducing that the polymer length acts as a kind of pseudo-potential which induces a dissipationless flow associated with the superfluid phase even in the absence of self-interactions.


title: Proper Network Interpretability Helps Adversarial Robustness in Classification

abstract: Recent works have empirically shown that there exist adversarial examples that can be hidden from neural network interpretability (namely, making network interpretation maps visually similar), or interpretability is itself susceptible to adversarial attacks. In this paper, we theoretically show that with a proper measurement of interpretation, it is actually difficult to prevent prediction-evasion adversarial attacks from causing interpretation discrepancy, as confirmed by experiments on MNIST, CIFAR-10 and Restricted ImageNet. Spurred by that, we develop an interpretability-aware defensive scheme built only on promoting robust interpretation (without the need for resorting to adversarial loss minimization). We show that our defense achieves both robust classification and robust interpretation, outperforming state-of-the-art adversarial training methods against attacks of large perturbation in particular.


title: Deepfake Detection using Spatiotemporal Convolutional Networks

abstract: Better generative models and larger datasets have led to more realistic fake videos that can fool the human eye but produce temporal and spatial artifacts that deep learning approaches can detect. Most current Deepfake detection methods only use individual video frames and therefore fail to learn from temporal information. We created a benchmark of the performance of spatiotemporal convolutional methods using the Celeb-DF dataset. Our methods outperformed state-of-the-art frame-based detection methods. Code for our paper is publicly available at https://github.com/oidelima/Deepfake-Detection.


title: Could regulating the creators deliver trustworthy AI?

abstract: Is a new regulated profession, such as Artificial Intelligence (AI) Architect who is responsible and accountable for AI outputs necessary to ensure trustworthy AI? AI is becoming all pervasive and is often deployed in everyday technologies, devices and services without our knowledge. There is heightened awareness of AI in recent years which has brought with it fear. This fear is compounded by the inability to point to a trustworthy source of AI, however even the term "trustworthy AI" itself is troublesome. Some consider trustworthy AI to be that which complies with relevant laws, while others point to the requirement to comply with ethics and standards (whether in addition to or in isolation of the law). This immediately raises questions of whose ethics and which standards should be applied and whether these are sufficient to produce trustworthy AI in any event.


title: Newton retraction as approximate geodesics on submanifolds

abstract: Efficient approximation of geodesics is crucial for practical algorithms on manifolds. Here we introduce a class of retractions on submanifolds, induced by a foliation of the ambient manifold. They match the projective retraction to the third order and thus match the exponential map to the second order. In particular, we show that Newton retraction (NR) is always stabler than the popular approach known as oblique projection or orthographic retraction: per Kantorovich-type convergence theorems, the superlinear convergence regions of NR include those of the latter. We also show that NR always has a lower computational cost. The preferable properties of NR are useful for optimization, sampling, and many other statistical problems on manifolds.


title: Prediction of the Number of COVID-19 Confirmed Cases Based on K-Means-LSTM

abstract: COVID-19 is a pandemic disease that began to rapidly spread in the US with the first case detected on January 19, 2020, in Washington State. March 9, 2020, and then increased rapidly with total cases of 25,739 as of April 20, 2020. The Covid-19 pandemic is so unnerving that it is difficult to understand how any person is affected by the virus. Although most people with coronavirus 81%, according to the U.S. Centers for Disease Control and Prevention (CDC), will have little to mild symptoms, others may rely on a ventilator to breathe or not at all. SEIR models have broad applicability in predicting the outcome of the population with a variety of diseases. However, many researchers use these models without validating the necessary hypotheses. Far too many researchers often "overfit" the data by using too many predictor variables and small sample sizes to create models. Models thus developed are unlikely to stand validity check on a separate group of population and regions. The researcher remains unaware that overfitting has occurred, without attempting such validation. In the paper, we present a combination algorithm that combines similar days features selection based on the region using Xgboost, K Means, and long short-term memory (LSTM) neural networks to construct a prediction model (i.e., K-Means-LSTM) for short-term COVID-19 cases forecasting in Louisana state USA. The weighted k-means algorithm based on extreme gradient boosting is used to evaluate the similarity between the forecasts and past days. The results show that the method with K-Means-LSTM has a higher accuracy with an RMSE of 601.20 whereas the SEIR model with an RMSE of 3615.83.


title: Flat traces for a random partially hyperbolic map

abstract: We consider a $\mathbb R/\mathbb Z$ extension of an Anosov diffemorphism of a compact Riemannian manifold by a random function $\tau$ and show that the flat traces of the transfer operator, reduced with respect to frequency in the fibers, converge in law towards Gaussians, up to an Ehrenfest time that decreases with the regularity of $\tau$.


title: Super-Necking Crystal Growth and Structural and Magnetic Properties of SrTb$_2$O$_4$ Single Crystals

abstract: We report on single-crystal growths of the SrTb$_2$O$_4$ compound by a super-necking technique with a laser-floating-zone furnace and study the stoichiometry, growth mode, and structural and magnetic properties by scanning electronic microscopy, neutron Laue, X-ray powder diffraction, and the physical property measurement system. We optimized the growth parameters, mainly the growth speed, atmosphere, and the addition of a Tb$_4$O$_7$ raw material. Neutron Laue diffraction displays the characteristic feature of a single crystal. Our study reveals an atomic ratio of Sr:Tb $ = 0.97(2){:}2.00(1)$ and a possible layer by layer crystal growth mode. Our X-ray powder diffraction study determines the crystal structure, lattice constants and atomic positions. The paramagnetic (PM) Curie--Weiss (CW) temperature $\theta_{\texttt{CW}} =$ 5.00(4) K, and the effective PM moment $M^{\texttt{eff}}_{\texttt{mea}} =$ 10.97(1) $\mu_\texttt{B}$ per Tb$^{3+}$ ion. The data of magnetization versus temperature can be divided into three regimes, showing a coexistence of antiferromagnetic and ferromagnetic interactions. This probably leads to the magnetic frustration in the SrTb$_2$O$_4$ compound. The magnetization at 2 K and 14 T originates from both the Tb1 and Tb2 sites and is strongly frustrated with an expected saturation field at $\sim$41.5 T, displaying an intricate phase diagram with three ranges.


title: DeltaGrad: Rapid retraining of machine learning models

abstract: Machine learning models are not static and may need to be retrained on slightly changed datasets, for instance, with the addition or deletion of a set of data points. This has many applications, including privacy, robustness, bias reduction, and uncertainty quantifcation. However, it is expensive to retrain models from scratch. To address this problem, we propose the DeltaGrad algorithm for rapid retraining machine learning models based on information cached during the training phase. We provide both theoretical and empirical support for the effectiveness of DeltaGrad, and show that it compares favorably to the state of the art.


title: Implications of the search for optical counterparts during the second part of the Advanced LIGO's and Advanced Virgo's third observing run: lessons learned for future follow-up observations

abstract: Joint multi-messenger observations with gravitational waves and electromagnetic data offer new insights into the astrophysical studies of compact objects. The third Advanced LIGO and Advanced Virgo observing run began on April 1, 2019; during the eleven months of observation, there have been 14 compact binary systems candidates for which at least one component is potentially a neutron star. Although intensive follow-up campaigns involving tens of ground and space-based observatories searched for counterparts, no electromagnetic counterpart has been detected. Following on a previous study of the first six months of the campaign, we present in this paper the next five months of the campaign from October 2019 to March 2020. We highlight two neutron star - black hole candidates (S191205ah, S200105ae), two binary neutron star candidates (S191213g and S200213t) and a binary merger with a possible neutron star and a "MassGap" component, S200115j. Assuming that the gravitational-wave candidates are of astrophysical origin and their location was covered by optical telescopes, we derive possible constraints on the matter ejected during the events based on the non-detection of counterparts. We find that the follow-up observations during the second half of the third observing run did not meet the necessary sensitivity to constrain the source properties of the potential gravitational-wave candidate. Consequently, we suggest that different strategies have to be used to allow a better usage of the available telescope time. We examine different choices for follow-up surveys to optimize sky localization coverage vs.\ observational depth to understand the likelihood of counterpart detection.


title: Painlev\'{e} V and the Hankel Determinant for a Singularly Perturbed Jacobi Weight

abstract: We study the Hankel determinant generated by a singularly perturbed Jacobi weight $$ w(x,t):=(1-x^2)^\alpha\mathrm{e}^{-\frac{t}{x^{2}}},\;\;\;\;\;\;x\in[-1,1],\;\;\alpha>0,\;\;t\geq 0. $$ If $t=0$, it is reduced to the classical symmetric Jacobi weight. For $t>0$, the factor $\mathrm{e}^{-\frac{t}{x^{2}}}$ induces an infinitely strong zero at the origin. This Hankel determinant is related to the Wigner time-delay distribution in chaotic cavities. In the finite $n$ dimensional case, we obtain two auxiliary quantities $R_n(t)$ and $r_n(t)$ by using the ladder operator approach. We show that the Hankel determinant has an integral representation in terms of $R_n(t)$, where $R_n(t)$ is closely related to a particular Painlev\'{e} V transcendent. Furthermore, we derive a second-order nonlinear differential equation and also a second-order difference equation for the logarithmic derivative of the Hankel determinant. This quantity can be expressed in terms of the Jimbo-Miwa-Okamoto $\sigma$-function of a particular Painlev\'{e} V. Then we consider the asymptotics of the Hankel determinant under a suitable double scaling, i.e. $n\rightarrow\infty$ and $t\rightarrow 0$ such that $s=2n^2 t$ is fixed. Based on previous results by using the Coulomb fluid method, we obtain the large $s$ and small $s$ asymptotic behaviors of the scaled Hankel determinant, including the constant term in the asymptotic expansion.


title: Meta Deformation Network: Meta Functionals for Shape Correspondence

abstract: We present a new technique named "Meta Deformation Network" for 3D shape matching via deformation, in which a deep neural network maps a reference shape onto the parameters of a second neural network whose task is to give the correspondence between a learned template and query shape via deformation. We categorize the second neural network as a meta-function, or a function generated by another function, as its parameters are dynamically given by the first network on a per-input basis. This leads to a straightforward overall architecture and faster execution speeds, without loss in the quality of the deformation of the template. We show in our experiments that Meta Deformation Network leads to improvements on the MPI-FAUST Inter Challenge over designs that utilized a conventional decoder design that has non-dynamic parameters.


title: Existence and convergence theorems for monotone generalized alpa-nonexpansive mappings in uniformly convex partially ordered hyperbolic metric spaces and its application

abstract: In this paper, we generalize the existence result in [14] and prove convergence theorems of the iterative scheme in [12, 16] for monotone generalized alpa-nonexpansive mappings in uniformly convex partially ordered hyperbolic metric spaces. And we also give a numerical example to show that this scheme converges faster than the scheme in [14] and apply the result to the integral equation.


title: Graphs of curves and arcs quasi-isometric to big mapping class groups

abstract: Following the work of Rosendal and Mann and Rafi, we try to answer the following question: when is the mapping class group of an infinite-type surface quasi-isometric to a graph whose vertices are curves on that surface? With the assumption of tameness as defined by Mann and Rafi, we describe a necessary and sufficient condition, called translatability, for a geometrically nontrivial big mapping class group to admit such a quasi-isometry. In addition, we show that the mapping class group of the plane minus a Cantor set is quasi-isometric to the loop graph defined by Bavard, which we believe represents the first example of a mapping class group known to be non-elementary hyperbolic.


title: Lesion Mask-based Simultaneous Synthesis of Anatomic and MolecularMR Images using a GAN

abstract: Data-driven automatic approaches have demonstrated their great potential in resolving various clinical diagnostic dilemmas for patients with malignant gliomas in neuro-oncology with the help of conventional and advanced molecular MR images. However, the lack of sufficient annotated MRI data has vastly impeded the development of such automatic methods. Conventional data augmentation approaches, including flipping, scaling, rotation, and distortion are not capable of generating data with diverse image content. In this paper, we propose a method, called synthesis of anatomic and molecular MR images network (SAMR), which can simultaneously synthesize data from arbitrary manipulated lesion information on multiple anatomic and molecular MRI sequences, including T1-weighted (T1w), gadolinium enhanced T1w (Gd-T1w), T2-weighted (T2w), fluid-attenuated inversion recovery (FLAIR), and amide proton transfer-weighted (APTw). The proposed framework consists of a stretch-out up-sampling module, a brain atlas encoder, a segmentation consistency module, and multi-scale label-wise discriminators. Extensive experiments on real clinical data demonstrate that the proposed model can perform significantly better than the state-of-the-art synthesis methods.


title: Optimal Capacity of a Battery Energy Storage System based on Solar Variability Index to Smooth out Power Fluctuations in PV-Diesel Microgrids

abstract: Battery energy storage systems can be integrated with photovoltaic (PV)-diesel microgrids, as an enabling technology to increase the penetration of PV systems and aid microgrid stability by smoothing out the power fluctuations of the PV systems. The aim of this paper is to derive correlations between the optimal capacity of the smoothing batteries and variabilities in daily solar irradiance. Two commonly used smoothing techniques of moving average and ramp rate control are applied on a real solar irradiance dataset with a 1-minute resolution for a full calendar year across 11 sites in Australia. The paper then presents the developed empirical model, based on linear regressions, to estimate the optimal capacity of the batteries without requiring the use of detailed simulation studies. The performance of the developed technique is validated by numerical simulation studies in MATLAB. The study demonstrates that the empirical model provided reasonably accurate estimates when using the moving average smoothing technique, but had limited accuracy under the ramp rate control technique.


title: PAC-Bayesian Bound for the Conditional Value at Risk

abstract: Conditional Value at Risk (CVaR) is a family of "coherent risk measures" which generalize the traditional mathematical expectation. Widely used in mathematical finance, it is garnering increasing interest in machine learning, e.g., as an alternate approach to regularization, and as a means for ensuring fairness. This paper presents a generalization bound for learning algorithms that minimize the CVaR of the empirical loss. The bound is of PAC-Bayesian type and is guaranteed to be small when the empirical CVaR is small. We achieve this by reducing the problem of estimating CVaR to that of merely estimating an expectation. This then enables us, as a by-product, to obtain concentration inequalities for CVaR even when the random variable in question is unbounded.


title: Khintchine's Theorem with rationals coming from neighborhoods in different places

abstract: The Duffin--Schaeffer Conjecture answers a question on how well one can approximate irrationals by rational numbers in reduced form (an imposed condition) where the accuracy of the approximation depends on the rational number. It can be viewed as an analogue to Khintchine's Theorem with the added restriction of only allowing rationals in reduced form. Other conditions such as numerator or denominator a prime, a square-free integer, or an element of a particular arithmetic progression, etc. have also been imposed and analogues of Khintchine's Theorem studied. We prove versions of Khintchine's Theorem where the rational numbers are sourced from a ball in some completion of $\mathbb{Q}$ (i.e. Euclidean or $p$-adic), while the approximations are carried out in a distinct second completion. Finally, by using a mass transference principle for Hausdorff measures, we are able to extend our results to their corresponding analogues with Haar measures replaced by Hausdorff measures, thereby establishing an analogue of Jarn\'ik's Theorem.


title: Analysis of Trending Topics and Text-based Channels of Information Delivery in Cybersecurity

abstract: Computer users are generally faced with difficulties in making correct security decisions. While an increasingly fewer number of people are trying or willing to take formal security training, online sources including news, security blogs, and websites are continuously making security knowledge more accessible. Analysis of cybersecurity texts can provide insights into the trending topics and identify current security issues as well as how cyber attacks evolve over time. These in turn can support researchers and practitioners in predicting and preparing for these attacks. Comparing different sources may facilitate the learning process for normal users by persisting the security knowledge gained from different cybersecurity context. Prior studies neither systematically analysed the wide-range of digital sources nor provided any standardisation in analysing the trending topics from recent security texts. Although LDA has been widely adopted in topic generation, its generated topics cannot cover the cybersecurity concepts completely and considerably overlap. To address this issue, we propose a semi-automated classification method to generate comprehensive security categories instead of LDA-generated topics. We further compare the identified 16 security categories across different sources based on their popularity and impact. We have revealed several surprising findings. (1) The impact reflected from cyber-security texts strongly correlates with the monetary loss caused by cybercrimes. (2) For most categories, security blogs share the largest popularity and largest absolute/relative impact over time. (3) Websites deliver security information without caring about timeliness much, where one third of the articles do not specify the date and the rest have a time lag in posting emerging security issues.


title: Calibrated Single-Contact Voltage Sensor for High-Voltage Monitoring Applications

abstract: A single-contact voltage sensor designed for accurate measurements of ac voltages across a pair of conductors is described. The sensor design is motivated by remote monitoring applications where accurate voltage measurement of high-voltage transmission lines is required. The body of the sensor is electrically and mechanically attached to a single conductor: either the neutral or high-voltage conductor. A capacitive sensing plate attached to the sensor creates a capacitive voltage divider using the stray capacitance to the non-contacted line. A very high-impedance buffer is used to measure the voltage across the divider output and estimate the line voltage. An important part of the work includes a method of calibrating the sensor such that blind voltage measurements can be made without knowing the exact geometry of the conductors. Other important aspects of the design include a two-stage voltage divider for retaining accuracy and increasing the voltage range of the sensor. The work is supported by extensive numerical simulation models which were used to determine the optimum design for the sensing plate and to evaluate the sensitivity to different configurations including conductor spacing and the height above ground. For calibration values which are accurate to 1%, the line voltage can be measured with an accuracy of 10%. The paper describes the theory, design, and experimental verification of the sensor up to a line voltage of 7.5 kVrms.


title: Dialog as a Vehicle for Lifelong Learning

abstract: Dialog systems research has primarily been focused around two main types of applications - task-oriented dialog systems that learn to use clarification to aid in understanding a goal, and open-ended dialog systems that are expected to carry out unconstrained "chit chat" conversations. However, dialog interactions can also be used to obtain various types of knowledge that can be used to improve an underlying language understanding system, or other machine learning systems that the dialog acts over. In this position paper, we present the problem of designing dialog systems that enable lifelong learning as an important challenge problem, in particular for applications involving physically situated robots. We include examples of prior work in this direction, and discuss challenges that remain to be addressed.


title: Deep Partition Aggregation: Provable Defense against General Poisoning Attacks

abstract: Adversarial poisoning attacks distort training data in order to corrupt the test-time behavior of a classifier. A provable defense provides a certificate for each test sample, which is a lower bound on the magnitude of any adversarial distortion of the training set that can corrupt the test sample's classification. We propose two novel provable defenses against poisoning attacks: (i) Deep Partition Aggregation (DPA), a certified defense against a general poisoning threat model, defined as the insertion or deletion of a bounded number of samples to the training set -- by implication, this threat model also includes arbitrary distortions to a bounded number of images and/or labels; and (ii) Semi-Supervised DPA (SS-DPA), a certified defense against label-flipping poisoning attacks. DPA is an ensemble method where base models are trained on partitions of the training set determined by a hash function. DPA is related to both subset aggregation, a well-studied ensemble method in classical machine learning, as well as to randomized smoothing, a popular provable defense against evasion attacks. Our defense against label-flipping attacks, SS-DPA, uses a semi-supervised learning algorithm as its base classifier model: each base classifier is trained using the entire unlabeled training set in addition to the labels for a partition. SS-DPA significantly outperforms the existing certified defense for label-flipping attacks on both MNIST and CIFAR-10: provably tolerating, for at least half of test images, over 600 label flips (vs. < 200 label flips) on MNIST and over 300 label flips (vs. 175 label flips) on CIFAR-10. Against general poisoning attacks, where no prior certified defenses exists, DPA can certify >= 50% of test images against over 500 poison image insertions on MNIST, and nine insertions on CIFAR-10. These results establish new state-of-the-art provable defenses against poisoning attacks.


title: Supermasks in Superposition

abstract: We present the Supermasks in Superposition (SupSup) model, capable of sequentially learning thousands of tasks without catastrophic forgetting. Our approach uses a randomly initialized, fixed base network and for each task finds a subnetwork (supermask) that achieves good performance. If task identity is given at test time, the correct subnetwork can be retrieved with minimal memory usage. If not provided, SupSup can infer the task using gradient-based optimization to find a linear superposition of learned supermasks which minimizes the output entropy. In practice we find that a single gradient step is often sufficient to identify the correct mask, even among 2500 tasks. We also showcase two promising extensions. First, SupSup models can be trained entirely without task identity information, as they may detect when they are uncertain about new data and allocate an additional supermask for the new training distribution. Finally the entire, growing set of supermasks can be stored in a constant-sized reservoir by implicitly storing them as attractors in a fixed-sized Hopfield network.


title: Volume of Seifert representations for graph manifolds and their finite covers

abstract: For any closed orientable 3-manifold, there is a volume function defined on the space of all Seifert representations of the fundamental group. The maximum absolute value of this function agrees with the Seifert volume of the manifold due to Brooks and Goldman. For any Seifert representation of a graph manifold, the authors establish an effective formula for computing its volume, and obtain restrictions to the representation as analogous to the Milnor--Wood inequality (about transversely projective foliations on Seifert fiber spaces). It is shown that the Seifert volume of any graph manifold is a rational multiple of $\pi^2$. Among all finite covers of a given non-geometric graph manifold, the supremum ratio of the Seifert volume over the covering degree can be a positive number, and can be infinite. Examples of both possibilities are discovered, and confirmed, with the explicit values determined for the finite ones.


title: Unique solvability of weakly homogeneous generalized variational inequalities

abstract: An interesting observation is that most pairs of weakly homogeneous mappings have no strongly monotonic property, which is one of the key conditions to ensure the unique solvability of the generalized variational inequality. This paper focuses on studying the unique solvability of the generalized variational inequality with a pair of weakly homogeneous mappings. By using a weaker condition than the strong monotonicity and some additional conditions, we achieve several results on the unique solvability of the underlying problem. These results are exported by making use of the exceptional family of elements or derived from new obtained Karamardian-type theorems or established under the exceptional regularity condition. They are new even when the problem comes down to its important subclasses studied in recent years.


title: Two robots moving geodesically on a tree

abstract: We study the geodesic complexity of the ordered and unordered configuration spaces of graphs in both the $\ell_1$ and $\ell_2$ metrics. We determine the geodesic complexity of the ordered two-point $\varepsilon$-configuration space of any star graph in both the $\ell_1$ and $\ell_2$ metrics and of the unordered two-point configuration space of any tree in the $\ell_1$ metric, by finding explicit geodesics from any pair to any other pair, and arranging them into a minimal number of continuously-varying families. In each case the geodesic complexity matches the known value of the topological complexity.


title: Pushing the Limit of Unsupervised Learning for Ultrasound Image Artifact Removal

abstract: Ultrasound (US) imaging is a fast and non-invasive imaging modality which is widely used for real-time clinical imaging applications without concerning about radiation hazard. Unfortunately, it often suffers from poor visual quality from various origins, such as speckle noises, blurring, multi-line acquisition (MLA), limited RF channels, small number of view angles for the case of plane wave imaging, etc. Classical methods to deal with these problems include image-domain signal processing approaches using various adaptive filtering and model-based approaches. Recently, deep learning approaches have been successfully used for ultrasound imaging field. However, one of the limitations of these approaches is that paired high quality images for supervised training are difficult to obtain in many practical applications. In this paper, inspired by the recent theory of unsupervised learning using optimal transport driven cycleGAN (OT-cycleGAN), we investigate applicability of unsupervised deep learning for US artifact removal problems without matched reference data. Experimental results for various tasks such as deconvolution, speckle removal, limited data artifact removal, etc. confirmed that our unsupervised learning method provides comparable results to supervised learning for many practical applications.


title: Co-Designing Statistical MIMO Radar and In-band Full-Duplex Multi-User MIMO Communications -- Part I: Signal Processing

abstract: We consider a spectral sharing problem in which a statistical (or widely distributed) multiple-input multiple-output (MIMO) radar and an in-band full-duplex (IBFD) multi-user MIMO (MU-MIMO) communications system concurrently operate within the same frequency band. Prior works on joint MIMO-radar-MIMO-communications (MRMC) systems largely focus on either colocated MIMO radars, half-duplex MIMO communications, single-user scenarios, omit practical constraints (clutter, uplink [UL]/downlink [DL] transmit powers, UL/DL quality-of-service, and peak-to-average-power ratio), or MRMC co-existence that employs separate transmit/receive units. The purpose of this and companion papers (Part II and III) is to co-design an MRMC framework that addresses all of these issues. In this paper, we propose signal processing for a distributed IBFD MRMC, where radar receiver is designed to additionally exploit the downlink communications signals reflected from a radar target. Extensive numerical experiments show that our methods improve radar target detection over conventional codes and yield a higher achievable data rate than standard precoders. The following companion paper (Part II) describes the theory and procedure of our algorithm to solve the non-convex design problem. The final companion paper (Part II) considers the case of multiple targets and examines the tracking performance of our MRMC system.


title: A virtual element approximation for the pseudostress formulation of the Stokes eigenvalue problem

abstract: In this paper we analyze a virtual element method (VEM) for a pseudostress formulation of the Stokes eigenvalue problem. This formulation allows to eliminate the velocity and the pressure, leading to an elliptic formulation where the only unknown is the pseudostress tensor. The velocity and pressure can be recovered by a post-process. Adapting the non-compact operator theory, we prove that our method provides a correct approximation of the spectrum and is spurious free. We prove a priori error estimates, with optimal order, which we confirm with some numerical tests.


title: Testing the cosmic opacity at higher redshifts: implication from quasars with available UV and X-ray observations

abstract: In this paper, we present a cosmological model-independent test for the cosmic opacity at high redshifts ($z\sim5$). We achieve this with the opacity-dependent luminosity distances derived from nonlinear relation between X-ray and UV emissions of quasars, combined with two types of opacity-independent luminosity distances derived from the Hubble parameter measurements and simulated gravitational wave (GW) events achievable with the Einstein Telescope (ET). In the framework of two phenomenological parameterizations adopted to describe cosmic opacity at high redshifts, our main results show that a transparent universe is supported by the current observational data at 2$\sigma$ confidence level. However, the derived value of the cosmic opacity is slightly sensitive to the parametrization of $\tau(z)$, which highlights the importance of choosing a reliable parametrization to describe the optical depth $\tau(z)$ in the early universe. Compared with the previous works, the combination of the quasar data and the $H(z)$/GW observations in similar redshift ranges provides a novel way to confirm a transparent universe ($\epsilon=0$ at higher redshifts $z\sim 5$), with an accuracy of $\Delta \epsilon\sim 10^{-2}$. More importantly, our findings indicate that a strong degeneracy between the cosmic opacity parameter and the parameters characterizing the $L_{UV}-L_X$ relation of quasars, which reinforces the necessity of proper calibration for such new type of high-redshift standard candle (in a cosmological model-independent way).


title: Group Gradings and Actions of Pointed Hopf Algebras

abstract: We study actions of pointed Hopf algebras on matrix algebras. Our approach is based on known facts about group gradings of matrix algebras.


title: Optimal Configuration of Wind-to-Ammonia with the Electric Network and Hydrogen Supply Chain: A Case Study of Inner Mongolia

abstract: Converting wind energy into ammonia (WtA) has been recognized as a promising pathway to enhance the usage of wind generation. This paper proposes a generic optimal configuration model of WtA at the network level to minimize the ammonia production cost by optimizing capacities and locations of WtA facilities including wind turbines, electrolyzers, hydrogen tanks and optimizing supply modes among regions. Specifically, the temporal fluctuation characteristics of wind resources, the operation flexibility of the ammonia synthesis reactor and the transport distances are considered. Three typical supply modes, i.e., the Local WtA, the EN (electric network)-based WtA and the HSC (hydrogen supply chain)-based WtA, combined with two energy transport modes including EN and HT (Hydrogen truck trailers) are included with the consideration of the maximal energy transport capacity of EN and transport distance per day of HT (500km). Real data of Inner Mongolia (a typical province in China with rich wind resources and existing ammonia industries) is employed to verify the effectiveness and significance of proposed model. The effect of above significant factors on optimal planning capacity of WtA facilities and optimal energy transport modes is analyzed, which provides guidelines for WtA configuration. The economic analysis shows that the average LCOA (levelized cost of ammonia) for WtA is approximately 0.57 euro/kg in Inner Mongolia and comparable to that for CtA (coal-to-ammonia, 0.41 euro/kg) with a reduction of 30% in capacity cost of the facilities.


title: Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

abstract: Many researchers motivate explainable AI with studies showing that human-AI team performance on decision-making tasks improves when the AI explains its recommendations. However, prior studies observed improvements from explanations only when the AI, alone, outperformed both the human and the best team. Can explanations help lead to complementary performance, where team accuracy is higher than either the human or the AI working solo? We conduct mixed-method user studies on three datasets, where an AI with accuracy comparable to humans helps participants solve a task (explaining itself in some conditions). While we observed complementary improvements from AI augmentation, they were not increased by explanations. Rather, explanations increased the chance that humans will accept the AI's recommendation, regardless of its correctness. Our result poses new challenges for human-centered AI: Can we develop explanatory approaches that encourage appropriate trust in AI, and therefore help generate (or improve) complementary performance?


title: Blind Image Deconvolution using Student's-t Prior with Overlapping Group Sparsity

abstract: In this paper, we solve blind image deconvolution problem that is to remove blurs form a signal degraded image without any knowledge of the blur kernel. Since the problem is ill-posed, an image prior plays a significant role in accurate blind deconvolution. Traditional image prior assumes coefficients in filtered domains are sparse. However, it is assumed here that there exist additional structures over the sparse coefficients. Accordingly, we propose new problem formulation for the blind image deconvolution, which utilizes the structural information by coupling Student's-t image prior with overlapping group sparsity. The proposed method resulted in an effective blind deconvolution algorithm that outperforms other state-of-the-art algorithms.


title: The huge Package for High-dimensional Undirected Graph Estimation in R

abstract: We describe an R package named huge which provides easy-to-use functions for estimating high dimensional undirected graphs from data. This package implements recent results in the literature, including Friedman et al. (2007), Liu et al. (2009, 2012) and Liu et al. (2010). Compared with the existing graph estimation package glasso, the huge package provides extra features: (1) instead of using Fortan, it is written in C, which makes the code more portable and easier to modify; (2) besides fitting Gaussian graphical models, it also provides functions for fitting high dimensional semiparametric Gaussian copula models; (3) more functions like data-dependent model selection, data generation and graph visualization; (4) a minor convergence problem of the graphical lasso algorithm is corrected; (5) the package allows the user to apply both lossless and lossy screening rules to scale up large-scale problems, making a tradeoff between computational and statistical efficiency.


title: WorkerRep: Immutable Reputation System For Crowdsourcing Platform Based on Blockchain

abstract: Crowdsourcing is a process wherein an individual or an organisation utilizes the talent pool present over the Internet to accomplish their task. The existing crowdsourcing platforms and their reputation computation are centralised and hence prone to various attacks or malicious manipulation of the data by the central entity. A few distributed crowdsourcing platforms have been proposed but they lack a robust reputation mechanism. So we propose a decentralised crowdsourcing platform having an immutable reputation mechanism to tackle these problems. It is built on top of Ethereum network and does not require the user to trust a third party for a non malicious experience. It also utilizes IOTAs consensus mechanism which reduces the cost for task evaluation significantly.


title: Twisted quantum affinizations and quantization of extended affine Lie algebras

abstract: In this paper, for an arbitrary Kac-Moody Lie algebra $\mathfrak g$ and a diagram automorphism $\mu$ of $\mathfrak g$ satisfying certain natural linking conditions, we introduce and study a $\mu$-twisted quantum affinization algebra $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$ of $\mathfrak g$. When $\mathfrak g$ is of finite type, $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$ is Drinfeld's current algebra realization of the twisted quantum affine algebra. When $\mu=\mathrm{id}$ and $\mathfrak g$ in affine type, $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$ is the quantum toroidal algebra introduced by Ginzburg, Kapranov and Vasserot. As the main results of this paper, we first prove a triangular decomposition for $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$. Second, we give a simple characterization of the affine quantum Serre relations on restricted $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$-modules in terms of "normal order products". Third, we prove that the category of restricted $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$-modules is a monoidal category and hence obtain a topological Hopf algebra structure on the "restricted completion" of $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$. Last, we study the classical limit of $\mathcal U_\hbar\left(\hat{\mathfrak g}_\mu\right)$ and abridge it to the quantization theory of extended affine Lie algebras. In particular, based on a classification result of Allison-Berman-Pianzola, we obtain the $\hbar$-deformation of all nullity $2$ extended affine Lie algebras.


title: Self-Scaling Clusters and Reproducible Containers to Enable Scientific Computing

abstract: Container technologies such as Docker have become a crucial component of many software industry practices especially those pertaining to reproducibility and portability. The containerization philosophy has influenced the scientific computing community, which has begun to adopt - and even develop - container technologies (such as Singularity). Leveraging containers for scientific software often poses challenges distinct from those encountered in industry, and requires different methodologies. This is especially true for HPC. With an increasing number of options for HPC in the cloud (including NSF-funded cloud projects), there is strong motivation to seek solutions that provide flexibility to develop and deploy scientific software on a variety of computational infrastructures in a portable and reproducible way. The flexibility offered by cloud services enables virtual HPC clusters that scale on-demand, and the Cyberinfrastructure Resource Integration team in the XSEDE project has developed a set of tools which provides scalable infrastructure in the cloud. We now present a solution which uses the Nix package manager in an MPI-capable Docker container that is converted to Singularity. It provides consistent installations, dependencies, and environments in each image that are reproducible and portable across scientific computing infrastructures. We demonstrate the utility of these containers with cluster benchmark runs in a self-scaling virtual cluster using the Slurm scheduler deployed in the Jetstream and Aristotle Red Cloud OpenStack clouds. We conclude this technique is useful as a template for scientific software application containers to be used in the XSEDE compute environment, other Singularity HPC environments, and cloud computing environments.


title: On Regret with Multiple Best Arms

abstract: We study a regret minimization problem with the existence of multiple best/near-optimal arms in the multi-armed bandit setting. We consider the case when the number of arms/actions is comparable or much larger than the time horizon, and make no assumptions about the structure of the bandit instance. Our goal is to design algorithms that can automatically adapt to the unknown hardness of the problem, i.e., the number of best arms. Our setting captures many modern applications of bandit algorithms where the action space is enormous and the information about the underlying instance/structure is unavailable. We first propose an adaptive algorithm that is agnostic to the hardness level and theoretically derive its regret bound. We then prove a lower bound for our problem setting, which indicates: (1) no algorithm can be minimax optimal simultaneously over all hardness levels; and (2) our algorithm achieves a rate function that is Pareto optimal. With additional knowledge of the expected reward of the best arm, we propose another adaptive algorithm that is minimax optimal, up to polylog factors, over all hardness levels. Experimental results confirm our theoretical guarantees and show advantages of our algorithms over the previous state-of-the-art.


title: Prime-universal diagonal quadratic forms

abstract: A (positive definite and integral) quadratic form is said to be $\textit{prime-universal}$ if it represents all primes. Recently, Doyle and Williams in [2] classified all prime-universal diagonal ternary quadratic forms, and all prime-universal diagonal quaternary quadratic forms under two conjectures proposed by themselves. In this article, we classify all prime-universal diagonal quadratic forms regardless of ranks. Furthermore, we prove, so called, $67$-Theorem for a diagonal quadratic form to be prime-universal.


title: On Equivariant and Invariant Learning of Object Landmark Representations

abstract: Given a collection of images, humans are able to discover landmarks by modeling the shared geometric structure across instances. This idea of geometric equivariance has been widely used for the unsupervised discovery of object landmark representations. In this paper, we develop a simple and effective approach by combining instance-discriminative and spatially-discriminative contrastive learning. We show that when a deep network is trained to be invariant to geometric and photometric transformations, representations emerge from its intermediate layers that are highly predictive of object landmarks. Stacking these across layers in a "hypercolumn" and projecting them using spatially-contrastive learning further improves their performance on matching and few-shot landmark regression tasks. We also present a unified view of existing equivariant and invariant representation learning approaches through the lens of contrastive learning, shedding light on the nature of invariances learned. Experiments on standard benchmarks for landmark learning, as well as a new challenging one we propose, show that the proposed approach surpasses prior state-of-the-art.


title: Ricci Curvature Based Volumetric Segmentation of the Auditory Ossicles

abstract: The auditory ossicles that are located in the middle ear are the smallest bones in the human body. Their damage will result in hearing loss. It is therefore important to be able to automatically diagnose ossicles' diseases based on Computed Tomography (CT) 3D imaging. However CT images usually include the whole head area, which is much larger than the bones of interest, thus the localization of the ossicles, followed by segmentation, both play a significant role in automatic diagnosis. The commonly employed local segmentation methods require manually selected initial points, which is a highly time consuming process. We therefore propose a completely automatic method to locate the ossicles which requires neither templates, nor manual labels. It relies solely on the connective properties of the auditory ossicles themselves, and their relationship with the surrounding tissue fluid. For the segmentation task, we define a novel energy function and obtain the shape of the ossicles from the 3D CT image by minimizing this new energy. Compared to the state-of-the-art methods which usually use the gradient operator and some normalization terms, we propose to add a Ricci curvature term to the commonly employed energy function. We compare our proposed method with the state-of-the-art methods and show that the performance of discrete Forman-Ricci curvature is superior to the others.


title: Shock formation and vorticity creation for 3d Euler

abstract: We analyze the shock formation process for the 3d non-isentropic Euler equations with the ideal gas law, in which sounds waves interact with entropy waves to produce vorticity. Building on our theory for isentropic flows in [3,4], we give a constructive proof of shock formation from smooth initial data. Specifically, we prove that there exist smooth solutions to the non-isentropic Euler equations which form a generic stable shock with explicitly computable blowup time, location, and direction. This is achieved by establishing the asymptotic stability of a generic shock profile in modulated self-similar variables, controlling the interaction of wave families via: (i) pointwise bounds along Lagrangian trajectories, (ii) geometric vorticity structure, and (iii) high-order energy estimates in Sobolev spaces.


title: Drug Repurposing to find Inhibitors of SARS-CoV-2 Main Protease

abstract: Severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is the strain of coronavirus that causes coronavirus disease 2019 (COVID-19), the respiratory illness responsible for the COVID-19 pandemic. Currently there is no known vaccine or specific antiviral treatment for COVID-19 and so, there is an urgent need for expedite discovery of new therapeutics to combat the disease until a vaccine will be available worldwide. Drug repurposing is a strategy for identifying new uses for approved drugs that has the advantage (over conventional approaches that attempt to develop a drug from scratch) that time frame of the overall process can be significantly reduced because of the few number of clinical trial required. In this work, a virtual screening of FDA-approved drugs was performed for repositioning as potential inhibitors of the main protease Mpro of SARS-CoV-2. As a result of this study, 12 drugs are proposed as candidates for inhibitors of the Mpro enzyme. Some of the selected compounds are antiviral drugs that are already being tested in COVID-19 clinical trials (i.e. ribavirin) or are used to alleviate symptoms of the disease (i.e. codeine). Surprisingly, the most promising candidate is the naturally occurring broad spectrum antibiotic oxytetracycline. This compound has largely outperformed the remaining selected candidates along all filtering steps of our virtual screening protocol. If the activity of any of these drugs is experimentally corroborated, they could be used directly in clinical trials without the need for pre-clinical testing or safety evaluation since they are already used as drugs for other diseases.


title: Structure and vibrational properties of sodium silicate glass surfaces

abstract: Using molecular dynamics simulations we investigate the dependence of the structural and vibrational properties of the surfaces of sodo-silicate glasses on the sodium content as well as the nature of the surface. Two types of glass surfaces are considered: A melt-formed surface (MS) in which a liquid with a free surface has been cooled down into the glass phase and a fracture surface (FS) obtained by tensile loading of a glass sample. We find that the MS is more abundant in Na and non-bridging oxygen atoms than the FS and the bulk glass, whereas the FS has higher concentration of structural defects such as two-membered rings and under-coordinated Si than the MS. We associate these structural differences to the production histories of the glasses and the mobility of the Na ions. It is also found that for Na-poor systems the fluctuations in composition and local atomic charge density decay with a power-law as a function of distance from the surface while Na-rich systems show an exponential decay with a typical decay length of $\approx2.3$~\AA. The vibrational density of states shows that the presence of the surfaces leads to a decrease of the characteristic frequencies in the system. The two-membered rings give rise to a pronounce band at $\approx880$~cm$^{-1}$ which is in good agreement experimental observations.


title: Math Course Redesign in a Private Four Year Hispanic Serving Institute to Address Diverse Equitable and Inclusive Issues

abstract: We identified three most challenging points related to diverse, equitable, and inclusive (DEI) issues. First, the majority of our students entering the College lack the math skills essential to success in Calculus, as basic as College Algebra, some others have a multi-year gap after graduating high school. Almost all but a few STEM students must start from College Algebra before they can move on to Precalculus and then Calculus. Secondly, we noted that many students who planned to pursue STEM dropped out of their majors because they couldn't obtain the required grade in College Algebra to move forward. This is one of the main reasons that the enrollment of calculus classes is consistently low. Lastly, a large portion of basic math classes are taught by adjunct instructors, the turnover ratio among adjunct instructors is not small. One such consequence is that many students don't have equitable learning experiences and some students are still struggling with College Algebra even in the calculus class. In this paper, we describe an illustrative case study of a college-wide initiative to tackle the DEI issues.


title: The TRaCaR Ratio: Selecting the Right Storage Technology for Active Dataset-Serving Databases

abstract: Main memory database systems aim to provide users with low latency and high throughput access to data. Most data resides in secondary storage, which is limited by the access speed of the technology. For hot content, data resides in DRAM, which has become increasingly expensive as datasets grow in size and access demand. With the emergence of low-latency storage solutions such as Flash and Intel's 3D XPoint (3DXP), there is an opportunity for these systems to give users high Quality-of-Service while reducing the cost for providers. To achieve high performance, providers must provision the server hosts for these datasets with the proper amount of DRAM and secondary storage, as well as selecting a storage technology. The growth of capacity and transaction load overtime makes it expensive to flip back-and-forth between different storage technologies and memory-storage combinations. Servers set up for one storage technology must now be reconfigured, repartitioned, and potentially replaced altogether. As more low-latency storage solutions become available, how does one decide on the right memory-storage combination, as well as selecting a storage technology, given a predicted trend in dataset growth and offered load? In this paper, we describe and make the case for using the TRaCaR ratio - the transaction rate divided by the storage capacity needed for a workload - for allowing providers to choose the most cost-effective memory-storage combination and storage technology given their predicted dataset trend and load requirement. We explore how the TRaCaR ratio can be used with 3DXP and Flash with a highly-zipfian b-tree database, and discuss potential research directions that can leverage the ratio.


title: The Signature Kernel is the solution of a Goursat PDE

abstract: Recently, there has been an increased interest in the development of kernel methods for learning with sequential data. The signature kernel is a learning tool with potential to handle irregularly sampled, multivariate time series. In "Kernels for sequentially ordered data" the authors introduced a kernel trick for the truncated version of this kernel avoiding the exponential complexity that would have been involved in a direct computation. Here we show that for continuously differentiable paths, the signature kernel solves a hyperbolic PDE and recognize the connection with a well known class of differential equations known in the literature as Goursat problems. This Goursat PDE only depends on the increments of the input sequences, does not require the explicit computation of signatures and can be solved efficiently using state-of-the-arthyperbolic PDE numerical solvers, giving a kernel trick for the untruncated signature kernel, with the same raw complexity as the method from "Kernels for sequentially ordered data", but with the advantage that the PDE numerical scheme is well suited for GPU parallelization, which effectively reduces the complexity by a full order of magnitude in the length of the input sequences. In addition, we extend the previous analysis to the space of geometric rough paths and establish, using classical results from rough path theory, that the rough version of the signature kernel solves a rough integral equation analogous to the aforementioned Goursat PDE. Finally, we empirically demonstrate the effectiveness of our PDE kernel as a machine learning tool in various machine learning applications dealing with sequential data. We release the library sigkernel publicly available at https://github.com/crispitagorico/sigkernel.


title: Q-Learning with Differential Entropy of Q-Tables

abstract: It is well-known that information loss can occur in the classic and simple Q-learning algorithm. Entropy-based policy search methods were introduced to replace Q-learning and to design algorithms that are more robust against information loss. We conjecture that the reduction in performance during prolonged training sessions of Q-learning is caused by a loss of information, which is non-transparent when only examining the cumulative reward without changing the Q-learning algorithm itself. We introduce Differential Entropy of Q-tables (DE-QT) as an external information loss detector to the Q-learning algorithm. The behaviour of DE-QT over training episodes is analyzed to find an appropriate stopping criterion during training. The results reveal that DE-QT can detect the most appropriate stopping point, where a balance between a high success rate and a high efficiency is met for classic Q-Learning algorithm.


title: AvE: Assistance via Empowerment

abstract: One difficulty in using artificial agents for human-assistive applications lies in the challenge of accurately assisting with a person's goal(s). Existing methods tend to rely on inferring the human's goal, which is challenging when there are many potential goals or when the set of candidate goals is difficult to identify. We propose a new paradigm for assistance by instead increasing the human's ability to control their environment, and formalize this approach by augmenting reinforcement learning with human empowerment. This task-agnostic objective preserves the person's autonomy and ability to achieve any eventual state. We test our approach against assistance based on goal inference, highlighting scenarios where our method overcomes failure modes stemming from goal ambiguity or misspecification. As existing methods for estimating empowerment in continuous domains are computationally hard, precluding its use in real time learned assistance, we also propose an efficient empowerment-inspired proxy metric. Using this, we are able to successfully demonstrate our method in a shared autonomy user study for a challenging simulated teleoperation task with human-in-the-loop training.


title: Mass Gap in U(1) Higgs-Yukawa model on a unit lattice

abstract: A non perturbative proof of the mass generation of fermions via the Higgs mechanism is given. This is done by showing exponential decay of the two point fermionic correlation function in a weakly coupled U(1) Higgs-Yukawa theory on a unit lattice in $d=4$. This decay implies that the Higgs boson, the photon and the fermion all have a non zero physical mass and the theory is said to have a mass gap.


title: Implicit Convex Regularizers of CNN Architectures: Convex Optimization of Two- and Three-Layer Networks in Polynomial Time

abstract: We study training of Convolutional Neural Networks (CNNs) with ReLU activations and introduce exact convex optimization formulations with a polynomial complexity with respect to the number of data samples, the number of neurons, and data dimension. More specifically, we develop a convex analytic framework utilizing semi-infinite duality to obtain equivalent convex optimization problems for several two- and three-layer CNN architectures. We first prove that two-layer CNNs can be globally optimized via an $\ell_2$ norm regularized convex program. We then show that multi-layer circular CNN training problems with a single ReLU layer are equivalent to an $\ell_1$ regularized convex program that encourages sparsity in the spectral domain. We also extend these results to three-layer CNNs with two ReLU layers. Furthermore, we present extensions of our approach to different pooling methods, which elucidates the implicit architectural bias as convex regularizers.


title: Evaluation of Text Generation: A Survey

abstract: The paper surveys evaluation methods of natural language generation (NLG) systems that have been developed in the last few years. We group NLG evaluation methods into three categories: (1) human-centric evaluation metrics, (2) automatic metrics that require no training, and (3) machine-learned metrics. For each category, we discuss the progress that has been made and the challenges still being faced, with a focus on the evaluation of recently proposed NLG tasks and neural NLG models. We then present two examples for task-specific NLG evaluations for automatic text summarization and long text generation, and conclude the paper by proposing future research directions.


title: Deep Predictive Learning in Neocortex and Pulvinar

abstract: How do humans learn from raw sensory experience? Throughout life, but most obviously in infancy, we learn without explicit instruction. We propose a detailed biological mechanism for the widely-embraced idea that learning is based on the differences between predictions and actual outcomes (i.e., predictive error-driven learning). Specifically, numerous weak projections into the pulvinar nucleus of the thalamus generate top-down predictions, and sparse, focal driver inputs from lower areas supply the actual outcome, originating in layer 5 intrinsic bursting (5IB) neurons. Thus, the outcome is only briefly activated, roughly every 100 msec (i.e., 10 Hz, alpha), resulting in a temporal difference error signal, which drives local synaptic changes throughout the neocortex, resulting in a biologically-plausible form of error backpropagation learning. We implemented these mechanisms in a large-scale model of the visual system, and found that the simulated inferotemporal (IT) pathway learns to systematically categorize 3D objects according to invariant shape properties, based solely on predictive learning from raw visual inputs. These categories match human judgments on the same stimuli, and are consistent with neural representations in IT cortex in primates.


title: Convergence Rates of Two-Component MCMC Samplers

abstract: Component-wise MCMC algorithms, including Gibbs and conditional Metropolis-Hastings samplers, are commonly used for sampling from multivariate probability distributions. A long-standing question regarding Gibbs algorithms is whether a deterministic-scan (systematic-scan) sampler converges faster than its random-scan counterpart. We answer this question when the samplers involve two components by establishing an exact quantitative relationship between the $L^2$ convergence rates of the two samplers. The relationship shows that the deterministic-scan sampler converges faster. We also establish qualitative relations among the convergence rates of two-component Gibbs samplers and some conditional Metropolis-Hastings variants. For instance, it is shown that if some two-component conditional Metropolis-Hastings samplers are geometrically ergodic, then so are the associated Gibbs samplers.


title: A Broad Class of Conservative Numerical Methods for Dispersive Wave Equations

abstract: We develop a general framework for designing conservative numerical methods based on summation by parts operators and split forms in space, combined with relaxation Runge-Kutta methods in time. We apply this framework to create new classes of fully-discrete conservative methods for several nonlinear dispersive wave equations: Benjamin-Bona-Mahony (BBM), Fornberg-Whitham, Camassa-Holm, Degasperis-Procesi, Holm-Hone, and the BBM-BBM system. These full discretizations conserve all linear invariants and one nonlinear invariant for each system. The spatial semidiscretizations include finite difference, spectral collocation, and both discontinuous and continuous finite element methods. The time discretization is essentially explicit, using relaxation Runge-Kutta methods. We implement some specific schemes from among the derived classes, and demonstrate their favorable properties through numerical tests.

categories: math.NA cs.NA physics.comp-ph physics.flu-dyn


title: Big-bang nucleosynthesis with sub-GeV massive decaying particles

abstract: We consider the effects of the injections of energetic photon and electron (or positron) on the big-bang nucleosynthesis. We study the photodissociation of light elements in the early Universe paying particular attention to the case that the injection energy is sub-GeV and derive upper bounds on the primordial abundances of the massive decaying particle as a function of its lifetime. We also discuss a solution of the $^7$Li problem in this framework.


title: Widening the Pipeline in Human-Guided Reinforcement Learning with Explanation and Context-Aware Data Augmentation

abstract: Human explanation (e.g., in terms of feature importance) has been recently used to extend the communication channel between human and agent in interactive machine learning. Under this setting, human trainers provide not only the ground truth but also some form of explanation. However, this kind of human guidance was only investigated in supervised learning tasks, and it remains unclear how to best incorporate this type of human knowledge into deep reinforcement learning. In this paper, we present the first study of using human visual explanations in human-in-the-loop reinforcement learning (HRL). We focus on the task of learning from feedback, in which the human trainer not only gives binary evaluative "good" or "bad" feedback for queried state-action pairs, but also provides a visual explanation by annotating relevant features in images. We propose EXPAND (EXPlanation AugmeNted feeDback) to encourage the model to encode task-relevant features through a context-aware data augmentation that only perturbs irrelevant features in human salient information. We choose five tasks, namely Pixel-Taxi and four Atari games, to evaluate the performance and sample efficiency of this approach. We show that our method significantly outperforms methods leveraging human explanation that are adapted from supervised learning, and Human-in-the-loop RL baselines that only utilize evaluative feedback.


title: Unexpected Circular Radio Objects at High Galactic Latitude

abstract: We have found a class of circular radio objects in the Evolutionary Map of the Universe Pilot Survey, using the Australian Square Kilometre Array Pathfinder telescope. The objects appear in radio images as circular edge-brightened discs, about one arcmin diameter, that are unlike other objects previously reported in the literature. We explore several possible mechanisms that might cause these objects, but none seems to be a compelling explanation.


title: TURL: Table Understanding through Representation Learning

abstract: Relational tables on the Web store a vast amount of knowledge. Owing to the wealth of such tables, there has been tremendous progress on a variety of tasks in the area of table understanding. However, existing work generally relies on heavily-engineered task-specific features and model architectures. In this paper, we present TURL, a novel framework that introduces the pre-training/fine-tuning paradigm to relational Web tables. During pre-training, our framework learns deep contextualized representations on relational tables in an unsupervised manner. Its universal model design with pre-trained representations can be applied to a wide range of tasks with minimal task-specific fine-tuning. Specifically, we propose a structure-aware Transformer encoder to model the row-column structure of relational tables, and present a new Masked Entity Recovery (MER) objective for pre-training to capture the semantics and knowledge in large-scale unlabeled data. We systematically evaluate TURL with a benchmark consisting of 6 different tasks for table understanding (e.g., relation extraction, cell filling). We show that TURL generalizes well to all tasks and substantially outperforms existing methods in almost all instances.


title: GINNs: Graph-Informed Neural Networks for Multiscale Physics

abstract: We introduce the concept of a Graph-Informed Neural Network (GINN), a hybrid approach combining deep learning with probabilistic graphical models (PGMs) that acts as a surrogate for physics-based representations of multiscale and multiphysics systems. GINNs address the twin challenges of removing intrinsic computational bottlenecks in physics-based models and generating large data sets for estimating probability distributions of quantities of interest (QoIs) with a high degree of confidence. Both the selection of the complex physics learned by the NN and its supervised learning/prediction are informed by the PGM, which includes the formulation of structured priors for tunable control variables (CVs) to account for their mutual correlations and ensure physically sound CV and QoI distributions. GINNs accelerate the prediction of QoIs essential for simulation-based decision-making where generating sufficient sample data using physics-based models alone is often prohibitively expensive. Using a real-world application grounded in supercapacitor-based energy storage, we describe the construction of GINNs from a Bayesian network-embedded homogenized model for supercapacitor dynamics, and demonstrate their ability to produce kernel density estimates of relevant non-Gaussian, skewed QoIs with tight confidence intervals.


title: Text Detection on Roughly Placed Books by Leveraging a Learning-based Model Trained with Another Domain Data

abstract: Text detection enables us to extract rich information from images. In this paper, we focus on how to generate bounding boxes that are appropriate to grasp text areas on books to help implement automatic text detection. We attempt not to improve a learning-based model by training it with an enough amount of data in the target domain but to leverage it, which has been already trained with another domain data. We develop algorithms that construct the bounding boxes by improving and leveraging the results of a learning-based method. Our algorithms can utilize different learning-based approaches to detect scene texts. Experimental evaluations demonstrate that our algorithms work well in various situations where books are roughly placed.


title: Quasinormal mode theory of elastic Purcell factors and Fano resonances of optomechanical beams

abstract: We introduce a quasinormal mode theory of mechanical open-cavity modes for optomechanical resonators, and demonstrate the importance of using a generalized (complex) effective mode volume and the phase of the quasinormal mode. We first generalize and fix the normal mode theories of the elastic Purcell factor, and then show a striking example of coupled quasinormal modes yielding a pronounced Fano resonance. Our theory is exemplified and confirmed by full three-dimensional calculations on optomechanical beams, but the general findings apply to a wide range of mechanical cavity modes. This quasinormal mechanical mode formalism, when also coupled with a quasinormal theory of optical cavities, offers a unified framework for describing a wide range of optomechanical structures where dissipation is an inherent part of the resonator modes.


title: Restarting Algorithms: Sometimes there is Free Lunch

abstract: In this overview article we will consider the deliberate restarting of algorithms, a meta technique, in order to improve the algorithm's performance, e.g., convergence rates or approximation guarantees. One of the major advantages is that restarts are relatively black box, not requiring any (significant) changes to the base algorithm that is restarted or the underlying argument, while leading to potentially significant improvements, e.g., from sublinear to linear rates of convergence. Restarts are widely used in different fields and have become a powerful tool to leverage additional information that has not been directly incorporated in the base algorithm or argument. We will review restarts in various settings from continuous optimization, discrete optimization, and submodular function maximization where they have delivered impressive results.