title: Structural engineering of transition-metal nitrides for surface-enhanced Raman scattering chips

abstract: Noble-metal-free surface-enhanced Raman scattering (SERS) substrates have attracted great attention for their abundant sources, good signal uniformity, superior biocompatibility, and high chemical stability. However, the lack of controllable synthesis and fabrication of noble-metal-free substrates with high SERS activity impedes their practical applications. Herein,we propose a general strategy to fabricate a series of planar transition-metal nitride (TMN) SERS chips via an ambient temperature sputtering deposition route.These planar TMN (tungsten nitride, tantalum nitride, and molybdenum nitride) chips show remarkable Raman enhancement factors (EFs) with ~105 owing to efficient photoinduced charge transfer process between TMN chips and probe molecules. Further, structural engineering of these TMN chips is used to improve their SERS activity. Benefiting from the synergistic effect of charge transfer process and electric field enhancement by constructing nanocavity structure, the Raman EF of WN nanocavity chips could be greatly improved to 1.29 * 107, which is an order of magnitude higher than that of planar chips. Moreover, we also design the WN/monolayer MoS2 heterostructure chips. With the increase of surface electron density on the upper WN and more exciton resonance transitions in the heterostructure, a 1.94 * 107 level EF and a 5 * 10-10 m level detention limit could be achieved. Our results provide important guidance for the structural design of ultrasensitive noble-metal-free SERS chips.


title: Strategy-Driven Limit Theorems Associated Bandit Problems

abstract: Motivated by the study of asymptotic behaviour of the bandit problems, we obtain several strategy-driven limit theorems including the law of large numbers, the large deviation principle, and the central limit theorem. Different from the classical limit theorems, we develop sampling strategy-driven limit theorems that generate the maximum or minimum average reward. The law of large numbers identifies all possible limits that are achievable under various strategies. The large deviation principle provides the maximum decay probabilities for deviations from the limiting domain. To describe the fluctuations around averages, we obtain strategy-driven central limit theorems under optimal strategies. The limits in these theorem are identified explicitly, and depend heavily on the structure of the events or the integrating functions and strategies. This demonstrates the key signature of the learning structure. Our results can be used to estimate the maximal (minimal) rewards, and to identify the conditions of avoiding the Parrondo's paradox in the two-armed bandit problem. It also lays the theoretical foundation for statistical inference in determining the arm that offers the higher mean reward.


title: Gravitational Collapse of Massless Vector Field with Positive Cosmological Constant

abstract: We investigate the dynamics of homogeneous gravitational collapse of a massless vector field in the presence of a positive cosmological constant $\Lambda$. The corresponding density function $\rho (a)$ obtained for the massless vector field is inversely proportional to the fourth power of the scale factor $a (t)$. The variation of the scale factor shows that for $0\, \le\Lambda < 1$, we obtain the gravitational collapse of the vector fields leading singularity formation in a {\it finite} comoving time resulting in a {\it Blackhole} such that with increasing $\Lambda$, the singularity formation time, $t_s$ increases. For $\Lambda = 1$, we obtain $a(t) = 0$, thus limiting the maximum value of $\Lambda$, (w.r.t the initial density $\rho_0$) for which the system could collapse under gravity.


title: Path-Tree Optimization in Discrete Partially Observable Environments using Rapidly-Exploring Belief-Space Graphs

abstract: Robots often need to solve path planning problems where essential and discrete aspects of the environment are partially observable. This introduces a multi-modality, where the robot must be able to observe and infer the state of its environment. To tackle this problem, we introduce the Path-Tree Optimization (PTO) algorithm which plans a path-tree in belief-space. A path-tree is a tree-like motion with branching points where the robot receives an observation leading to a belief-state update. The robot takes different branches depending on the observation received. The algorithm has three main steps. First, a rapidly-exploring random graph (RRG) on the state space is grown. Second, the RRG is expanded to a belief-space graph by querying the observation model. In a third step, dynamic programming is performed on the belief-space graph to extract a path-tree. The resulting path-tree combines exploration with exploitation i.e. it balances the need for gaining knowledge about the environment with the need for reaching the goal. We demonstrate the algorithm capabilities on navigation and mobile manipulation tasks, and show its advantage over a baseline using a task and motion planning approach (TAMP) both in terms of optimality and runtime.


title: Bayesian evidence-driven diagnosis of instrumental systematics for sky-averaged 21-cm cosmology experiments

abstract: We demonstrate the effectiveness of a Bayesian evidence-based analysis for diagnosing and disentangling the sky-averaged 21-cm signal from instrumental systematic effects. As a case study, we consider a simulated REACH pipeline with an injected systematic. We demonstrate that very poor performance or erroneous signal recovery is achieved if the systematic remains unmodelled. These effects include sky-averaged 21-cm posterior estimates resembling a very deep or wide signal. However, when including parameterised models of the systematic, the signal recovery is dramatically improved in performance. Most importantly, a Bayesian evidence-based model comparison is capable of determining whether or not such a systematic model is needed as the true underlying generative model of an experimental dataset is in principle unknown. We, therefore, advocate a pipeline capable of testing a variety of potential systematic errors with the Bayesian evidence acting as the mechanism for detecting their presence.


title: Northcott numbers for the weighted Weil heights

abstract: We answer the question of Vidaux and Videla about the distribution of the Northcott numbers for the Weil height. We solve the same problem for the weighted Weil heights. These heights generalize both the absolute and relative Weil height. Our results also refine those of Pazuki, Technau, and Widmer.


title: Stable topological phase transitions without symmetry indications in NaZnSb$_{1-x}$Bi$_x$

abstract: We study topological phase transitions in tetragonal NaZnSb$_{1-x}$Bi$_x$, driven by the chemical composition $x$. Notably, we examine mirror Chern numbers that change without symmetry indicators. First-principles calculations are performed to show that NaZnSb$_{1-x}$Bi$_x$ experiences consecutive topological phase transitions, diagnosed by the strong $\mathbb Z_{2}$ topological index $\nu_{0}$ and two mirror Chern numbers $\mu_{x}$ and $\mu_{xy}$. As the chemical composition $x$ increases, the topological invariants ($\mu_{x}\mu_{xy}\nu_{0}$) change from $(000)$, $(020)$, $(220)$, to $(111)$ at $x$ = 0.15, 0.20, and 0.53, respectively. A simplified low-energy effective model is developed to examine the mirror Chern number changes, highlighting the central role of spectator Dirac fermions in avoiding symmetry indicators. Our findings suggest that NaZnSb$_{1-x}$Bi$_{x}$ can be an exciting testbed for the exploration of the interplay between the topology and symmetry.


title: Nilpotent left quasigroups

abstract: In this paper we investigate central congruence of left quasigroups in the sense of Freese and McKenzie \cite{comm} and we extend some known results for quandles. In particular, we can extend the characterization of finite nilpotent latin quandles and the characterization of distributive varieties of quandles to the setting of idempotent left quasigroups.


title: Parameter estimation with gravitational waves

abstract: The new era of gravitational wave astronomy truly began on September 14, 2015 with the detection of GW150914, the sensational first direct observation of gravitational waves from the inspiral and merger of two black holes by the two Advanced LIGO detectors. In the subsequent first three observing runs of the LIGO/Virgo network, gravitational waves from $\sim 50$ compact binary mergers have been announced, with more results to come. The events have mostly been produced by binary black holes, but two binary neutron star mergers have so far been observed, as well as the mergers of two neutron star - black hole systems. Furthermore, gravitational waves emitted by core-collapse supernovae, pulsars and the stochastic gravitational wave background are within the LIGO/Virgo/KAGRA sensitivity band and are likely to be observed in future observation runs. Beyond signal detection, a major challenge has been the development of statistical and computational methodology for estimating the physical waveform parameters and quantifying their uncertainties in order to accurately characterise the emitting system. These methods depend on the sources of the gravitational waves and the gravitational waveform model that is used. This article reviews the main waveform models and parameter estimation methods used to extract physical parameters from gravitational wave signals detected to date by LIGO and Virgo and from those expected to be observed in the future, which will include KAGRA, and how these methods interface with various aspects of LIGO/Virgo/KAGRA science. Also presented are the statistical methods used by LIGO and Virgo to estimate detector noise, test general relativity, and draw conclusions about the rates of compact binary mergers in the universe. Furthermore, a summary of major publicly available gravitational wave parameter estimation software packages is given.


title: Distributed Evolution Strategies for Black-box Stochastic Optimization

abstract: This work concerns the evolutionary approaches to distributed stochastic black-box optimization, in which each worker can individually solve an approximation of the problem with nature-inspired algorithms. We propose a distributed evolution strategy (DES) algorithm grounded on a proper modification to evolution strategies, a family of classic evolutionary algorithms, as well as a careful combination with existing distributed frameworks. On smooth and nonconvex landscapes, DES has a convergence rate competitive to existing zeroth-order methods, and can exploit the sparsity, if applicable, to match the rate of first-order methods. The DES method uses a Gaussian probability model to guide the search and avoids the numerical issue resulted from finite-difference techniques in existing zeroth-order methods. The DES method is also fully adaptive to the problem landscape, as its convergence is guaranteed with any parameter setting. We further propose two alternative sampling schemes which significantly improve the sampling efficiency while leading to similar performance. Simulation studies on several machine learning problems suggest that the proposed methods show much promise in reducing the convergence time and improving the robustness to parameter settings.


title: An Axially Symmetric Transitioning models with Observational Constraints

abstract: In this study, we have demonstrated the expansion history of an axially symmetric Bianchi type-I model of the universe. Our model as of now presents an accelerating universe, which had been in the decelerating phase in the past. Roles of the two crucial Hubble~$H(z)$ and deceleration~$q(z)$ parameters are examined. The energy parameters of the universe are estimated with the help of the latest observational Hubble data (46-data points) and Pantheon data (the latest compilation of SNIa with 40 binned in the redshift range $0.014 \leq z \leq 1.62)$. We also discuss the stability analysis of the model by state finder diagnosis. The analysis reveals that in late time, the model is a quintessence type and points towards the $\Lambda$CDM model. Our developed model agrees with observational findings in a proper way. We have discussed some of the physical aspects of the model.


title: Refined Convergence and Topology Learning for Decentralized SGD with Heterogeneous Data

abstract: One of the key challenges in decentralized and federated learning is to design algorithms that efficiently deal with highly heterogeneous data distributions across agents. In this paper, we revisit the analysis of the popular Decentralized Stochastic Gradient Descent algorithm (D-SGD) under data heterogeneity. We exhibit the key role played by a new quantity, called neighborhood heterogeneity, on the convergence rate of D-SGD. By coupling the communication topology and the heterogeneity, our analysis sheds light on the poorly understood interplay between these two concepts. We then argue that neighborhood heterogeneity provides a natural criterion to learn data-dependent topologies that reduce (and can even eliminate) the otherwise detrimental effect of data heterogeneity on the convergence time of D-SGD. For the important case of classification with label skew, we formulate the problem of learning such a good topology as a tractable optimization problem that we solve with a Frank-Wolfe algorithm. As illustrated over a set of simulated and real-world experiments, our approach provides a principled way to design a sparse topology that balances the convergence speed and the per-iteration communication costs of D-SGD under data heterogeneity.


title: Exclusive semileptonic $B_c$-meson decays to radially excited charmonium and charm meson states

abstract: In the wake of recent measurements of ratios of semileptonic branching fractions: ${\cal R}_{J/\psi}, {\cal R}_D$ and ${\cal R}_{D^*}$ reported by the LHCb, BELLE and HFLAV Collaborations, we calculate invariant form factors for the exclusive semileptonic $B_c$-meson decays to radially excited charmonium and charm meson states in the full kinematical region within the framework of relativistic independent quark (RIQ)model. We evaluate the lepton mass effect in the decay processes induced by $b\to c,u$ transition at the quark level. Our predictions on branching fractions for $B_c\to \eta_c/\psi(nS)$ are found $\sim10^{-2}-10^{-4}$ and that for $B_c\to D^*(nS)$ are $\sim 10^{-4}$ in their $e^-$ decay modes, which lie within the detection accuracy of current experiment. Our predictions on branching fractions, forward backward asymmetry and asymmetry parameter are found in reasonable agreement with other model predictions; which can hopefully be tested in future experiments at LHC and Tevatron. Our predicted observable ${\cal R}$ in this sector are found comparable to other standard model (SM) predictions that violate the lepton flavor universality hinting at new physics beyond SM.


title: Bifurcation analysis of strongly nonlinear injection locked spin torque oscillators

abstract: We investigate the dynamics of an injection locked in-plane uniform spin torque oscillator for several forcing configurations at large driving amplitudes. For the analysis, the spin wave amplitude equation is used to reduce the dynamics to a general oscillator equation in which the forcing is a complex valued function $F(p,{\psi})\propto{\epsilon}_1 (p)cos({\psi})+i{\epsilon}_2 (p)sin({\psi})$. Assuming that the oscillator is strongly nonisochronous and/or forced by a power forcing $(|{\nu}{\epsilon}_1/{\epsilon}_2 |\gg 1)$, we show that the parameters ${\epsilon}_{1,2} (p)$ govern the main bifurcation features of the Arnold tongue diagram : (i) the locking range asymmetry is mainly controlled by $d{\epsilon}_1 (p)/dp$, (ii) the Taken-Bogdanov bifurcation occurs for a power threshold depending on ${\epsilon}_{1,2} (p)$ and (iii) the frequency hysteretic range is related to the transient regime through the resonant frequency at zero mismatch frequency. Then, the model is compared with the macrospin simulation for driving amplitudes as large as $10^0-10^3 A/m$ for the magnetic field and $10^{10}-10^{12} A/m^2$ for the current density. As predicted by the model, the forcing configuration (nature of the driving signal, applied direction, the harmonic orders) affects substantially the oscillator dynamic. However, some discrepancies are observed. In particular, the prediction of the frequency and power locking range boundaries may be misestimated if the hysteretic boundaries are of same magnitude order. Moreover, the misestimation can be of two different types according if the bifurcation is Saddle node or Taken Bogdanov. These effects are a further manifestation of the complexity of the dynamics in nonisochronous auto-oscillators.


title: Noise-based Enhancement for Foveated Rendering

abstract: Human visual sensitivity to spatial details declines towards the periphery. Novel image synthesis techniques, so-called foveated rendering, exploit this observation and reduce the spatial resolution of synthesized images for the periphery, avoiding the synthesis of high-spatial-frequency details that are costly to generate but not perceived by a viewer. However, contemporary techniques do not make a clear distinction between the range of spatial frequencies that must be reproduced and those that can be omitted. For a given eccentricity, there is a range of frequencies that are detectable but not resolvable. While the accurate reproduction of these frequencies is not required, an observer can detect their absence if completely omitted. We use this observation to improve the performance of existing foveated rendering techniques. We demonstrate that this specific range of frequencies can be efficiently replaced with procedural noise whose parameters are carefully tuned to image content and human perception. Consequently, these frequencies do not have to be synthesized during rendering, allowing more aggressive foveation, and they can be replaced by noise generated in a less expensive post-processing step, leading to improved performance of the rendering system. Our main contribution is a perceptually-inspired technique for deriving the parameters of the noise required for the enhancement and its calibration. The method operates on rendering output and runs at rates exceeding 200FPS at 4K resolution, making it suitable for integration with real-time foveated rendering systems for VR and AR devices. We validate our results and compare them to the existing contrast enhancement technique in user experiments.


title: Approximation-free control based on the bioinspired reference model for suspension systems with uncertainty and unknown nonlinearity

abstract: Uncertainty and unknown nonlinearity are often inevitable in the suspension systems, which were often solved using fuzzy logic system (FLS) or neural networks (NNs). However, these methods are restricted by the structural complexity of the controller and the huge computing cost. Meanwhile, the estimation error of such approximators is affected by adopted adaptive laws and learning gains. Thus, in view of the above problem, this paper proposes the approximation-free control based on the bioinspired reference model for a class of uncertain suspension systems with unknown nonlinearity. The proposed method integrates the superior vibration suppression of the bioinspired reference model and the structural advantage of the prescribed performance function (PPF) in approximation-free control. Then, the vibration suppression performance is improved, the calculation burden is relieved, and the transient performance is improved, which is analyzed theoretically in this paper. Finally, the simulation results validate the approach, and the comparisons show the advantages of the proposed control method in terms of good vibration suppression, fast convergence, and less calculation burden.


title: Refining time-space traffic diagrams: A simple multiple linear regression model

abstract: A time-space traffic (TS) diagram, which presents traffic states in time-space cells with color, is an important traffic analysis and visualization tool. Despite its importance for transportation research and engineering, most TS diagrams that have already existed or are being produced are too coarse to exhibit detailed traffic dynamics due to the limitations of existing information technology and traffic infrastructure investment. To increase the resolution of a TS diagram and enable it to present ample traffic details, this paper introduces the TS diagram refinement problem and proposes a multiple linear regression-based model to solve the problem. Two tests, which attempt to increase the resolution of a TS diagram 4 and 16 times, are carried out to evaluate the performance of the proposed model. Data collected at different times, in different locations and even in different countries are employed to thoroughly evaluate the accuracy and transferability of the proposed model. Strict tests with diverse data show that the proposed model, despite its simplicity, is able to refine a TS diagram with promising accuracy and reliable transferability. The proposed refinement model will "save" widely existing TS diagrams from their blurry "faces" and enable TS diagrams to show more traffic details.


title: Understanding, Detecting, and Separating Out-of-Distribution Samples and Adversarial Samples in Text Classification

abstract: In this paper, we study the differences and commonalities between statistically out-of-distribution (OOD) samples and adversarial (Adv) samples, both of which hurting a text classification model's performance. We conduct analyses to compare the two types of anomalies (OOD and Adv samples) with the in-distribution (ID) ones from three aspects: the input features, the hidden representations in each layer of the model, and the output probability distributions of the classifier. We find that OOD samples expose their aberration starting from the first layer, while the abnormalities of Adv samples do not emerge until the deeper layers of the model. We also illustrate that the models' output probabilities for Adv samples tend to be more unconfident. Based on our observations, we propose a simple method to separate ID, OOD, and Adv samples using the hidden representations and output probabilities of the model. On multiple combinations of ID, OOD datasets, and Adv attacks, our proposed method shows exceptional results on distinguishing ID, OOD, and Adv samples.


title: The Variance of the Sum of Two Squares over Intervals in $\mathbb{F}_q [T]$: I

abstract: For $B \in \mathbb{F}_q [T]$ of degree $2n \geq 2$, consider the number of ways of writing $B=E^2 + \gamma F^2$, where $\gamma \in \mathbb{F}_q^*$ is fixed, and $E,F \in \mathbb{F}_q [T]$ with $\mathrm{deg} \hspace{0.25em} E = n$ and $\mathrm{deg} \hspace{0.25em} F = m < n$. We denote this by $S_{\gamma ; m} (B)$. We obtain an exact formula for the variance of $S_{\gamma ; m} (B)$ over intervals in $\mathbb{F}_q [T]$. We use the method of additive characters and Hankel matrices that the author previously used for the variance and correlations of the divisor function. In Section 2, we give a short overview of our approach; and we briefly discuss the possible extension of our result to the number of ways of writing $B=E^2 + T F^2$.


title: Packing measure and dimension of the limit sets of IFSs of generalized complex continued fractions

abstract: We consider a family of conformal iterated function systems (for short, CIFSs) of generalized complex continued fractions. Note that in our previous paper we showed that the proper-dimensional Hausdorff measure of the limit set is zero and the packing measure of the limit set with respect to the Hausdorff dimension is positive. In this paper, we show that the packing dimension and the Hausdorff dimension of the limit set of each CIFS in the family are equal, and the proper-dimensional packing measure of the limit set is finite.


title: Modeling and mechanical perturbations reveal how spatially regulated anchorage gives rise to spatially distinct mechanics across the mammalian spindle

abstract: During cell division, the spindle generates force to move chromosomes. In mammals, microtubule bundles called kinetochore-fibers (k-fibers) attach to and segregate chromosomes. To do so, k-fibers must be robustly anchored to the dynamic spindle. We previously developed microneedle manipulation to mechanically challenge k-fiber anchorage, and observed spatially distinct response features revealing the presence of heterogeneous anchorage (Suresh et al. 2020). How anchorage is precisely spatially regulated, and what forces are necessary and sufficient to recapitulate the k-fiber's response to force remain unclear. Here, we develop a coarse-grained k-fiber model and combine with manipulation experiments to infer underlying anchorage using shape analysis. By systematically testing different anchorage schemes, we find that forces solely at k-fiber ends are sufficient to recapitulate unmanipulated k-fiber shapes, but not manipulated ones for which lateral anchorage over a 3 $\mu$m length scale near chromosomes is also essential. Such anchorage robustly preserves k-fiber orientation near chromosomes while allowing pivoting around poles. Anchorage over a shorter length scale cannot robustly restrict pivoting near chromosomes, while anchorage throughout the spindle obstructs pivoting at poles. Together, this work reveals how spatially regulated anchorage gives rise to spatially distinct mechanics in the mammalian spindle, which we propose are key for function.


title: A3CLNN: Spatial, Spectral and Multiscale Attention ConvLSTM Neural Network for Multisource Remote Sensing Data Classification

abstract: The problem of effectively exploiting the information multiple data sources has become a relevant but challenging research topic in remote sensing. In this paper, we propose a new approach to exploit the complementarity of two data sources: hyperspectral images (HSIs) and light detection and ranging (LiDAR) data. Specifically, we develop a new dual-channel spatial, spectral and multiscale attention convolutional long short-term memory neural network (called dual-channel A3CLNN) for feature extraction and classification of multisource remote sensing data. Spatial, spectral and multiscale attention mechanisms are first designed for HSI and LiDAR data in order to learn spectral- and spatial-enhanced feature representations, and to represent multiscale information for different classes. In the designed fusion network, a novel composite attention learning mechanism (combined with a three-level fusion strategy) is used to fully integrate the features in these two data sources. Finally, inspired by the idea of transfer learning, a novel stepwise training strategy is designed to yield a final classification result. Our experimental results, conducted on several multisource remote sensing data sets, demonstrate that the newly proposed dual-channel A3CLNN exhibits better feature representation ability (leading to more competitive classification performance) than other state-of-the-art methods.


title: A Family of Lanthanide Noncentrosymmetric Superconductors La$_4$$TX$ ($T$ = Ru, Rh, Ir; $X$ = Al, In)

abstract: We report the discovery of superconductivity in a series of noncentrosymmetric compounds La$_4$$TX$ ($T$ = Ru, Rh, Ir; $X$ = Al, In), which have a cubic crystal structure with space group $F\bar{4}3m$. La$_4$RuAl, La$_4$RhAl, La$_4$IrAl, La$_4$RuIn and La$_4$IrIn exhibit bulk superconducting transitions with critical temperatures $T_c$ of 1.77 K, 3.05 K, 1.54 K, 0.58 K and 0.93 K, respectively. The specific heat of the La$_4$$T$Al compounds are consistent with an $s$-wave model with a fully open superconducting gap. In all cases, the upper critical fields are well described by the Werthamer-Helfand-Hohenberg model, and the values are well below the Pauli limit, indicating that orbital limiting is the dominant pair-breaking mechanism. Density functional theory (DFT) calculations reveal that the degree of band splitting by the antisymmetric spin-orbit coupling (ASOC) shows considerable variation between the different compounds. This indicates that the strength of the ASOC is highly tunable across this series of superconductors, suggesting that these are good candidates for examining the relationship between the ASOC and superconducting properties in noncentrosymmetric superconductors.


title: Multichannel Speech Separation with Narrow-band Conformer

abstract: This work proposes a multichannel speech separation method with narrow-band Conformer (named NBC). The network is trained to learn to automatically exploit narrow-band speech separation information, such as spatial vector clustering of multiple speakers. Specifically, in the short-time Fourier transform (STFT) domain, the network processes each frequency independently, and is shared by all frequencies. For one frequency, the network inputs the STFT coefficients of multichannel mixture signals, and predicts the STFT coefficients of separated speech signals. Clustering of spatial vectors shares a similar principle with the self-attention mechanism in the sense of computing the similarity of vectors and then aggregating similar vectors. Therefore, Conformer would be especially suitable for the present problem. Experiments show that the proposed narrow-band Conformer achieves better speech separation performance than other state-of-the-art methods by a large margin.


title: Localization of moving sources: uniqueness, stability, and Bayesian inference

abstract: We consider the subsonic moving point source problem for the scalar wave equation in $\pmb{R}^3$, proving a regularity result for the direct problem, and uniqueness and stability results for the inverse problem. We then present and investigate numerically a Bayesian framework for the inference of the source trajectory and intensity from wave field measurements. The framework employs Gaussian process priors, the pre-conditioned Crank-Nicholson scheme with Markov Chain Monte Carlo sampling, and conditioning on functionals to include prior information on the source trajectory.


title: Ultrasound Signal Processing: From Models to Deep Learning

abstract: Medical ultrasound imaging relies heavily on high-quality signal processing to provide reliable and interpretable image reconstructions. Conventionally, reconstruction algorithms where derived from physical principles. These algorithms rely on assumptions and approximations of the underlying measurement model, limiting image quality in settings were these assumptions break down. Conversely, more sophisticated solutions based on statistical modelling, careful parameter tuning, or through increased model complexity, can be sensitive to different environments. Recently, deep learning based methods, which are optimized in a data-driven fashion, have gained popularity. These model-agnostic techniques often rely on generic model structures, and require vast training data to converge to a robust solution. A relatively new paradigm combines the power of the two: leveraging data-driven deep learning, as well as exploiting domain knowledge. These model-based solutions yield high robustness, and require less parameters and training data than conventional neural networks. In this work we provide an overview of these techniques from recent literature, and discuss a wide variety of ultrasound applications. We aim to inspire the reader to further research in this area, and to address the opportunities within the field of ultrasound signal processing. We conclude with a future perspective on model-based deep learning techniques for medical ultrasound.


title: Bayesian parameter-estimation of Galactic binaries in LISA data with Gaussian Process Regression

abstract: The Laser Interferometer Space Antenna (LISA), which is currently under construction, is designed to measure gravitational wave signals in the milli-Hertz frequency band. It is expected that tens of millions of Galactic binaries will be the dominant sources of observed gravitational waves. The Galactic binaries producing signals at mHz frequency range emit quasi monochromatic gravitational waves, which will be constantly measured by LISA. To resolve as many Galactic binaries as possible is a central challenge of the upcoming LISA data set analysis. Although it is estimated that tens of thousands of these overlapping gravitational wave signals are resolvable, and the rest blurs into a galactic foreground noise; extracting tens of thousands of signals using Bayesian approaches is still computationally expensive. We developed a new end-to-end pipeline using Gaussian Process Regression to model the log-likelihood function in order to rapidly compute Bayesian posterior distributions. Using the pipeline we are able to solve the Lisa Data Challenge (LDC) 1-3 consisting of noisy data as well as additional challenges with overlapping signals and particularly faint signals.


title: Simultaneously Enhanced Tenacity, Rupture Work, and Thermal Conductivity of Carbon Nanotubes Fibers by Increasing the Effective Tube Contribution

abstract: Although individual carbon nanotubes (CNTs) are superior as constituents to polymer chains, the mechanical and thermal properties of CNT fibers (CNTFs) remain inferior to commercial synthetic fibers due to the lack of synthesis methods to embed CNTs effectively in superstructures. The application of conventional techniques for mechanical enhancement resulted in a mild improvement of target properties while achieving parity at best on others. In this work, a Double-Drawing technique is developed to deform continuously grown CNTFs and rearrange the constituent CNTs in both mesoscale and nanoscale morphology. Consequently, the mechanical and thermal properties of the resulting CNTFs can be jointly improved, and simultaneously reach their highest performances with specific strength (tenacity) $\rm\sim3.30\,N\,tex^{-1}$, work of rupture $\rm\sim70\,J\,g^{-1}$, and thermal conductivity $\rm\sim354\,W\,m^{-1}\,K^{-1}$, despite starting from commercial low-crystallinity materials ($I{\rm_G}:I{\rm_D}\sim5$). The processed CNTFs are more versatile than comparable carbon fiber, Zylon, Dyneema, and Kevlar. Furthermore, based on evidence of load transfer efficiency on individual CNTs measured with In-Situ Stretching Raman, we find the main contributors to property enhancements are (1) the increased proportion of load-bearing CNT bundles and (2) the extension of effective length of tubes attached on these bundles.


title: Modified Heider Balance on Sparse Random Networks

abstract: The lack of signed random networks in standard balance studies has prompted us to extend the Hamiltonian of the standard balance model. Random networks with tunable parameters are suitable for better understanding the behavior of standard balance as an underlying dynamics. Moreover, the standard balance model in its original form does not allow preserving tensed triads in the network. Therefore, the thermal behavior of the balance model has been investigated on a fully connected signed network recently. It has been shown that the model undergoes an abrupt phase transition with temperature. Considering these two issues together, we examine the thermal behavior of the structural balance model defined on Erd\H{o}s-R\'enyi random networks. We provide a Mean-Field solution for the model. We observe a first-order phase transition with temperature, for both the sparse and densely connected networks. We detect two transition temperatures, $T_{cold}$ and $T_{hot}$, characterizing a hysteresis loop. We find that with increasing the network sparsity, both $T_{cold}$ and $T_{hot}$ decrease. But the slope of decreasing $T_{hot}$ with sparsity is larger than the slope of decreasing $T_{cold}$. Hence, the hysteresis region gets narrower, until, in a certain sparsity, it disappears. We provide a phase diagram in the temperature-tie density plane to observe the meta-stable/coexistence region behavior more accurately. Then we justify our Mean-Field results with a series of Monte-Carlo simulations.


title: Thermodynamics of the Reissner-Nordstr\"om-de Sitter Spacetime with Quintessence

abstract: For Anti-de Sitte (AdS) black holes, the isochoric heat capacity of system is vanished, while the isobaric heat capacity is not. However, this situation does not hold on for de Sitter (dS) black holes. In this work, by introducing the interaction between the black hole horizon and the cosmological horizon of the Reissner-Nordstr\"om-de Sitter (RNdS) spacetime with quintessence, we discuss the phase transition of this system. The results show that the spacetime not only has the similar phase transition behavior to that of Van der Waals (VdW) system, and the non-vanishing isochoric heat capacity fulfills the whole thermodynamics system. Through the discussion of the entropic force between two horizons, we find out the role of entropic force in the evolution of spacetime. In addition, we also study the influence of various parameters on the phase transition and entropic force, which will provide a new method for exploring the interaction among black hole molecules from a micro perspective.


title: Conceptualizing World-Earth System resilience: Exploring transformation pathways towards a safe and just operating space for humanity

abstract: We develop a framework within which to conceptualize World-Earth System resilience. Our notion of World-Earth System resilience emphasizes the need to move beyond the basin of attraction notion of resilience as we are not in a basin we can stay in. We are on a trajectory to a new basin and we have to avoid falling into undesirable basins. We thus focus on `pathway resilience', i.e. the relative number of paths that allow us to move from the transitional operating space we occupy now as we leave the Holocene basin to a safe and just operating space in the Anthropocene. We develop a mathematical model to formalize this conceptualization and demonstrate how interactions between earth system resilience (biophysical processes) and world system resilience (social processes) impact pathway resilience. Our findings show that building earth system resilience is probably our only chance to reach a safe and just operating space. We also illustrate the importance of world system dynamics by showing how the notion of fairness coupled with regional inequality affects pathway resilience.


title: A BAT-based Exact-Solution Algorithm for the Series-Parallel Redundancy Allocation Problem with Mixed Components

abstract: The series-parallel (active) redundancy allocation problem with mixed components (RAP) involves setting reliable objectives for components or subsystems to meet the resource consumption constraint, e.g., the total cost. RAP has been an active research area for the past four decades. The NP-hard difficulties confronted by RAP are maintaining feasibility with respect to two constraints: cost and weight. A novel algorithm called the bound-rule-BAT (BRB) based on the binary-addition-tree algorithm (BAT), the dominance rule, and dynamic bounds are proposed to solve the exact solutions of the most famous RAP benchmark problems called the (33-variation) Fyffe RAP. From the experiments, the proposed BRB can solve the Fyffe RAP correctly under the assumption that the maximal number of components of each subsystem is eight, and this is the first exact-solution algorithm that can solve the Fyffe RAP within 8 seconds and 60 seconds if no reliability lower bound is used.


title: White dwarfs in a uniform sphere approximation, with general relativity effects taken into account

abstract: The limiting mass of cold white dwarfs was first calculated by E. Stoner in an approximate model of a uniform star and was soon reduced by ~20% in papers by S. Chandrasekhar and L. D. Landau based on an exact solution of the equations for the stellar equilibrium. Here we examine uniform models of white dwarfs taking general relativity effects and the influence of finite temperature into account. Solutions are obtained in the form of finite analytic formulas and, for masses differing by no more than ~20% from the exact solutions, found by numerical integration of the differential equations for the stellar equilibrium.


title: Algebraic number fields generated by an infinite family of monogenic trinomials

abstract: For an infinite family of monogenic trinomials $P(X) = X^3\pm 3rbX-b$ in $\mathbb{Z}\lbrack X\rbrack$, arithmetical invariants of the cubic number field $L = \mathbb{Q}(\theta)$, generated by a zero $\theta$ of $P(X)$, and of its Galois closure $N = L(\sqrt{d(L)})$ are determined. The conductor $f$ of the cyclic cubic relative extension $N/K$, where $K = \mathbb{Q}(\sqrt{d(L)})$ denotes the unique quadratic subfield of $N$, is proved to be of the form $3^eb$ with $e\in\lbrace 1,2\rbrace$, which admits statements concerning primitive ambiguous principal ideals, lattice minima, and independent units in $L$. The number $m$ of non-isomorphic cubic fields $L_1,\ldots,L_m$ sharing a common discriminant $d(L_i) = d(L)$ with $L$ is determined.


title: Adaptive Sparse Sampling for Quasiparticle Interference Imaging

abstract: Quasiparticle interference imaging (QPI) offers insight into the band structure of quantum materials from the Fourier transform of local density of states (LDOS) maps. Their acquisition with a scanning tunneling microscope is traditionally tedious due to the large number of required measurements that may take several days to complete. The recent demonstration of sparse sampling for QPI imaging showed how the effective measurement time could be fundamentally reduced by only sampling a small and random subset of the total LDOS. However, the amount of required sub-sampling to faithfully recover the QPI image remained a recurring question. Here we introduce an adaptive sparse sampling (ASS) approach in which we gradually accumulate sparsely sampled LDOS measurements until a desired quality level is achieved via compressive sensing recovery. The iteratively measured random subset of the LDOS can be interleaved with regular topographic images that are used for image registry and drift correction. These reference topographies also allow to resume interrupted measurements to further improve the QPI quality. Our ASS approach is a convenient extension to quasiparticle interference imaging that should remove further hesitation in the implementation of sparse sampling mapping schemes.


title: High-dimensional Asymptotics of Langevin Dynamics in Spiked Matrix Models

abstract: We study Langevin dynamics for recovering the planted signal in the spiked matrix model. We provide a "path-wise" characterization of the overlap between the output of the Langevin algorithm and the planted signal. This overlap is characterized in terms of a self-consistent system of integro-differential equations, usually referred to as the Crisanti-Horner-Sommers-Cugliandolo-Kurchan (CHSCK) equations in the spin glass literature. As a second contribution, we derive an explicit formula for the limiting overlap in terms of the signal-to-noise ratio and the injected noise in the diffusion. This uncovers a sharp phase transition -- in one regime, the limiting overlap is strictly positive, while in the other, the injected noise overcomes the signal, and the limiting overlap is zero.


title: FoundationLayerNorm: Scaling BERT and GPT to 1,000 Layers

abstract: The mainstream BERT/GPT model contains only 10 to 20 layers, and there is little literature to discuss the training of deep BERT/GPT. This paper proposes a simple yet effective method to stabilize BERT and GPT training. We successfully scale up BERT and GPT to 1,000 layers, which is an order of magnitude deeper than previous BERT and GPT. The proposed method FoundationLayerNormalization enables efficient training of deep neural networks and is validated at the 1000-layer scale.


title: Spotlight on Charge-Transfer Excitons in Crystalline Textured n-Alkyl Anilino Squaraine Thin Films

abstract: Prototypical n-alkyl terminated anilino squaraines for photovoltaic applications show characteristic double-hump absorption features peaking in the green and deep-red spectral range. These signatures result from coupling of an intramolecular Frenkel exciton and an intermolecular charge transfer exciton. Crystalline, textured thin films suitable for polarized spectro-microscopy have been obtained for compounds with n-hexyl (nHSQ) and n-octyl (nOSQ) terminal alkyl chains. The here released triclinic crystal structure of nOSQ is similar to the known nHSQ crystal structure. Consequently, crystallites from both compounds show equal pronounced linear dichroism with two distinct polarization directions. The difference in polarization angle between the two absorbance maxima cannot be derived by spatial considerations from the crystal structure alone but requires theoretical modeling. Using an essential state model, the observed polarization behavior was discovered to depend on the relative contributions of the intramolecular Frenkel exciton and the intermolecular charge transfer exciton to the total transition dipole moment. For both nHSQ and nOSQ, the contribution of the charge transfer exciton to the total transition dipole moment was found to be small compared to the intramolecular Frenkel exciton. Therefore, the net transition dipole moment is largely determined by the intramolecular component resulting in a relatively small mutual difference between the polarization angles. Ultimately, the molecular alignment within the micro-textured crystallites can be deduced and, with that, the excited state transitions can be spotted.


title: On local antimagic vertex coloring for complete full $t$-ary trees

abstract: Let $G = (V, E)$ be a finite simple undirected graph without $K_2$ components. A bijection $f : E \rightarrow \{1, 2,\cdots, |E|\}$ is called a local antimagic labeling if for any two adjacent vertices $u$ and $v$, they have different vertex sums, i.e., $w(u) \neq w(v)$, where the vertex sum $w(u) = \sum_{e \in E(u)} f(e)$, and $E(u)$ is the set of edges incident to $u$. Thus any local antimagic labeling induces a proper vertex coloring of $G$ where the vertex $v$ is assigned the color (vertex sum) $w(v)$. The local antimagic chromatic number $\chi_{la}(G)$ is the minimum number of colors taken over all colorings induced by local antimagic labelings of $G$. It was conjectured \cite{Aru-Wang} that for every tree $T$ the local antimagic chromatic number $l+ 1 \leq \chi_{la} ( T )\leq l+2$, where $l$ is the number of leaves of $T$. In this article we verify the above conjecture for complete full $t$-ary trees, for $t \geq 2$. A complete full $t$-ary tree is a rooted tree in which all nodes have exactly $t$ children except leaves and every leaf is of the same depth. In particular we obtain that the exact value for the local antimagic chromatic number of all complete full $t$-ary trees is $ l+1$ for odd $t$.


title: Every countable group admits amenable actions on stably finite simple C*-algebras

abstract: We give the first examples of (non-amenable group) amenable actions on stably finite simple C*-algebras. More precisely, we give such actions for any countable group in an explicit way. The main ingredients of our construction are the full Fock space of the regular representation and a trace-scaling automorphism.


title: KUCST@LT-EDI-ACL2022: Detecting Signs of Depression from Social Media Text

abstract: In this paper we present our approach for detecting signs of depression from social media text. Our model relies on word unigrams, part-of-speech tags, readabilitiy measures and the use of first, second or third person and the number of words. Our best model obtained a macro F1-score of 0.439 and ranked 25th, out of 31 teams. We further take advantage of the interpretability of the Logistic Regression model and we make an attempt to interpret the model coefficients with the hope that these will be useful for further research on the topic.


title: The Almost Schur Lemma in Quaternionic Contact Geometry

abstract: We establish quaternionic contact (qc) versions of the so called Almost Schur Lemma, which give estimations of the qc scalar curvature on a compact qc manifold to be a constant in terms of the norm of the $[-1]$-component and the norm of the trace-free part of the $[3]$-component of the horizontal qc Ricci tensor and the torsion endomorphism, under certain positivity conditions.


title: Why did I fail? A Causal-based Method to Find Explanations for Robot Failures

abstract: Robot failures in human-centered environments are inevitable. Therefore, the ability of robots to explain such failures is paramount for interacting with humans to increase trust and transparency. To achieve this skill, the main challenges addressed in this paper are I) acquiring enough data to learn a cause-effect model of the environment and II) generating causal explanations based on that model. We address I) by learning a causal Bayesian network from simulation data. Concerning II), we propose a novel method that enables robots to generate contrastive explanations upon task failures. The explanation is based on setting the failure state in contrast with the closest state that would have allowed for a successful execution. This state is found through breadth-first search and is based on success predictions from the learned causal model. We assessed our method in two different scenarios I) stacking cubes and II) dropping spheres into a container. The obtained causal models reach a sim2real accuracy of 70% and 72%, respectively. We finally show that our novel method scales over multiple tasks and allows real robots to give failure explanations like 'the upper cube was stacked too high and too far to the right of the lower cube.'


title: Data-analysis software framework 2DMAT and its application to experimental measurements for two-dimensional material structures

abstract: An open-source data-analysis framework 2DMAT has been developed for experimental measurements of two-dimensional material structures. 2DMAT offers five analysis methods: (i) Nelder-Mead optimization, (ii) grid search, (iii) Bayesian optimization, (iv) replica exchange Monte Carlo method, and (v) population-annealing Monte Carlo method. Methods (ii) through (v) are implemented by parallel computation,which is efficient not only for personal computers but also for supercomputers.The current version of 2DMAT is applicable to total-reflection high-energy positron diffraction (TRHEPD), surface X-ray diffraction (SXRD), and low-energy electron diffraction (LEED) experiments by installing corresponding forward problem solvers that generate diffraction intensity data from a given dataset of the atomic positions. The analysis methods are general and can be applied also to other experiments and problems.


title: Isospin dependent properties of the isotopic chain of Scandium and Titanium nuclei within the relativistic mean-field formalism

abstract: The density-dependent nuclear symmetry energy is directly related to the isospin asymmetry for finite and infinite nuclear systems. It is critical to determine the coefficients of symmetry energy and its related observables as it holds great importance in different areas of nuclear physics, such as analyzing the structure of ground state exotic nuclei and neutron star study. The ground state bulk properties such as nuclear binding energy, quadrupole deformation, two-neutron separation energy, the differential variation of two-neutron separation energy, and root-mean-square charge radius for Scandium (Z = 21), and Titanium (Z = 22) nuclei are calculated. The coherent density fluctuation model is used to estimate the isospin-dependent properties of finite nuclei such as symmetry energy and its surface and volume components from its corresponding value in infinite nuclear matter system. Finally, we correlate the neutron-skin thickness with the coefficient of symmetry energy and its related observables corresponding to these isotopic chains of nuclei. The relativistic mean-field formalism with non-linear NL3 and Relativistic-Hartree-Bogoliubov with density-dependent DD-ME2 interaction parameters are employed in the present analysis. A shape transition is observed from spherical to prolate near N $\geq$ 44 and N $\geq$ 40 for Sc- and Ti- isotopic chain, respectively. Notable signatures of shell and/or sub-shell closures have been found for the magic neutron numbers at N = 20 and 28 for both the isotopic chain using the nuclear bulk and isospin quantities. In addition to these, a few signatures of shell/sub-shell closure are observed near the drip-line region, at N = 34 and 50 by following the surface/isospin dependent observables, namely symmetry energy and its component for both the isotopic chain of odd-A Sc- and even-even Ti- nuclei.


title: Primary photons, boson star and phase transition

abstract: We analyse the possibility that the dark matter candidate is from the approximate scale symmetry theory of the hidden scalar sector. The study includes the warm dark matter scenario and the Bose-Einstein condensation which may lead to the scalar boson stars (BS) giving rise to direct detection through the observation of the primary (direct) photons. The dynamical system of the scalar particles, the dilatons, at finite temperature and chemical potential is considered. The fluctuation of the particle density increases sharply within the increasing of the temperature. When the phase transition approaches, the fluctuation of the particle density has the non-monotonous rising when the ground state of the relative chemical potential tends to the critical value equal to one accompanying by the infinite number of particles. Our results suggest that the phase transition in the BS may be identified through the fluctuation in yield of primary photons induced directly by the conformal anomaly. The fluctuation rate of the photons grows up intensively in the infra-red to become very large at the phase transition.


title: Informativeness and Invariance: Two Perspectives on Spurious Correlations in Natural Language

abstract: Spurious correlations are a threat to the trustworthiness of natural language processing systems, motivating research into methods for identifying and eliminating them. However, addressing the problem of spurious correlations requires more clarity on what they are and how they arise in language data. Gardner et al (2021) argue that the compositional nature of language implies that \emph{all} correlations between labels and individual "input features" are spurious. This paper analyzes this proposal in the context of a toy example, demonstrating three distinct conditions that can give rise to feature-label correlations in a simple PCFG. Linking the toy example to a structured causal model shows that (1) feature-label correlations can arise even when the label is invariant to interventions on the feature, and (2) feature-label correlations may be absent even when the label is sensitive to interventions on the feature. Because input features will be individually correlated with labels in all but very rare circumstances, domain knowledge must be applied to identify spurious correlations that pose genuine robustness threats.


title: Comparison of EEG based epilepsy diagnosis using neural networks and wavelet transform

abstract: Epilepsy is one of the common neurological disorders characterized by recurrent and uncontrollable seizures, which seriously affect the life of patients. In many cases, electroencephalograms signal can provide important physiological information about the activity of the human brain which can be used to diagnose epilepsy. However, visual inspection of a large number of electroencephalogram signals is very time-consuming and can often lead to inconsistencies in physicians' diagnoses. Quantification of abnormalities in brain signals can indicate brain conditions and pathology so the electroencephalogram (EEG) signal plays a key role in the diagnosis of epilepsy. In this article, an attempt has been made to create a single instruction for diagnosing epilepsy, which consists of two steps. In the first step, a low-pass filter was used to preprocess the data and three separate mid-pass filters for different frequency bands and a multilayer neural network were designed. In the second step, the wavelet transform technique was used to process data. In particular, this paper proposes a multilayer perceptron neural network classifier for the diagnosis of epilepsy, that requires normal data and epilepsy data for education, but this classifier can recognize normal disorders, epilepsy, and even other disorders taught in educational examples. Also, the value of using electroencephalogram signal has been evaluated in two ways: using wavelet transform and non-using wavelet transform. Finally, the evaluation results indicate a relatively uniform impact factor on the use or non-use of wavelet transform on the improvement of epilepsy data functions, but in the end, it was shown that the use of perceptron multilayer neural network can provide a higher accuracy coefficient for experts.


title: ShorTor: Improving Tor Network Latency via Multi-hop Overlay Routing

abstract: We present ShorTor, a protocol for reducing latency on the Tor network. ShorTor uses multi-hop overlay routing, a technique typically employed by content delivery networks, to influence the route Tor traffic takes across the internet. ShorTor functions as an overlay on top of onion routing-Tor's existing routing protocol and is run by Tor relays, making it independent of the path selection performed by Tor clients. As such, ShorTor reduces latency while preserving Tor's existing security properties. Specifically, the routes taken in ShorTor are in no way correlated to either the Tor user or their destination, including the geographic location of either party. We analyze the security of ShorTor using the AnoA framework, showing that ShorTor maintains all of Tor's anonymity guarantees. We augment our theoretical claims with an empirical analysis. To evaluate ShorTor's performance, we collect a real-world dataset of over 400,000 latency measurements between the 1,000 most popular Tor relays, which collectively see the vast majority of Tor traffic. With this data, we identify pairs of relays that could benefit from ShorTor: that is, two relays where introducing an additional intermediate network hop results in lower latency than the direct route between them. We use our measurement dataset to simulate the impact on end users by applying ShorTor to two million Tor circuits chosen according to Tor's specification. ShorTor reduces the latency for the 99th percentile of relay pairs in Tor by 148 ms. Similarly, ShorTor reduces the latency of Tor circuits by 122 ms at the 99th percentile. In practice, this translates to ShorTor truncating tail latencies for Tor which has a direct impact on page load times and, consequently, user experience on the Tor browser.


title: First-passage process in degree space for the time-dependent Erd\H{o}s-R\'enyi and Watts-Strogatz models

abstract: In this work, we investigate the temporal evolution of the degree of a given vertex in a network by mapping the dynamics into a random walk problem in degree space. We analyze when the degree approximates a pre-established value through a parallel with the first-passage problem of random walks. The method is illustrated on the time-dependent versions of the Erd\H{o}s-R\'enyi and Watts-Strogatz models, which originally were formulated as static networks. We have succeeded in obtaining an analytic form for the first and the second moments of the first-passage time and showing how they depend on the size of the network. The dominant contribution for large networks with $N$ vertices indicates that these quantities scale on the ratio $N/p$, where $p$ is the linking probability.


title: Bayesian evidence-driven likelihood selection for sky-averaged 21-cm signal extraction

abstract: We demonstrate that the Bayesian evidence can be used to find a good approximation of the ground truth likelihood function of a dataset, a goal of the likelihood-free inference (LFI) paradigm. As a concrete example, we use forward modelled sky-averaged 21-cm signal antenna temperature datasets where we artificially inject noise structures of various physically motivated forms. We find that the Gaussian likelihood performs poorly when the noise distribution deviates from the Gaussian case e.g. heteroscedastic radiometric or heavy-tailed noise. For these non-Gaussian noise structures, we show that the generalised normal likelihood is on a similar Bayesian evidence scale with comparable sky-averaged 21-cm signal recovery as the ground truth likelihood function of our injected noise. We therefore propose the generalised normal likelihood function as a good approximation of the true likelihood function if the noise structure is a priori unknown.


title: S4OD: Semi-Supervised learning for Single-Stage Object Detection

abstract: Single-stage detectors suffer from extreme foreground-background class imbalance, while two-stage detectors do not. Therefore, in semi-supervised object detection, two-stage detectors can deliver remarkable performance by only selecting high-quality pseudo labels based on classification scores. However, directly applying this strategy to single-stage detectors would aggravate the class imbalance with fewer positive samples. Thus, single-stage detectors have to consider both quality and quantity of pseudo labels simultaneously. In this paper, we design a dynamic self-adaptive threshold (DSAT) strategy in classification branch, which can automatically select pseudo labels to achieve an optimal trade-off between quality and quantity. Besides, to assess the regression quality of pseudo labels in single-stage detectors, we propose a module to compute the regression uncertainty of boxes based on Non-Maximum Suppression. By leveraging only 10% labeled data from COCO, our method achieves 35.0% AP on anchor-free detector (FCOS) and 32.9% on anchor-based detector (RetinaNet).


title: Entanglement-invertible channels

abstract: In a well-known result [Werner2001], Werner classified all tight quantum teleportation and dense coding schemes, showing that they correspond to unitary error bases. Here tightness is a certain dimensional restriction: the quantum system to be teleported and the entangled resource must be of dimension d, and the measurement must have d^2 outcomes. In this work we generalise this classification so as to remove the dimensional restriction altogether, thereby resolving an open problem raised in that work. In fact, we classify not just teleportation and dense coding schemes, but entanglement-reversible channels. These are channels between finite-dimensional C*-algebras which are reversible with the aid of an entangled resource state, generalising ordinary reversibility of a channel. In Werner's classification, a bijective correspondence between tight teleportation and dense coding schemes was shown: swapping Alice and Bob's operations turns a teleportation scheme into a dense coding scheme and vice versa. We observe that this property generalises ordinary invertibility of a channel; we call it entanglement-invertibility. We show that entanglement-invertible channels are precisely the quantum bijections previously studied in the setting of quantum combinatorics [Musto2018], which are classified in terms of the representation theory of the quantum permutation group.


title: DeepLIIF: An Online Platform for Quantification of Clinical Pathology Slides

abstract: In the clinic, resected tissue samples are stained with Hematoxylin-and-Eosin (H&E) and/or Immunhistochemistry (IHC) stains and presented to the pathologists on glass slides or as digital scans for diagnosis and assessment of disease progression. Cell-level quantification, e.g. in IHC protein expression scoring, can be extremely inefficient and subjective. We present DeepLIIF (https://deepliif.org), a first free online platform for efficient and reproducible IHC scoring. DeepLIIF outperforms current state-of-the-art approaches (relying on manual error-prone annotations) by virtually restaining clinical IHC slides with more informative multiplex immunofluorescence staining. Our DeepLIIF cloud-native platform supports (1) more than 150 proprietary/non-proprietary input formats via the Bio-Formats standard, (2) interactive adjustment, visualization, and downloading of the IHC quantification results and the accompanying restained images, (3) consumption of an exposed workflow API programmatically or through interactive plugins for open source whole slide image viewers such as QuPath/ImageJ, and (4) auto scaling to efficiently scale GPU resources based on user demand.


title: Directly determining orbital angular momentum of ultrashort Laguerre-Gauss pulses via autocorrelation measurement

abstract: Autocorrelation measurement based on second-harmonic generation (SHG), the best-known technique for measuring the temporal duration of ultrashort pulses, could date back to the birth of ultrafast lasers. Here, we propose and experimentally demonstrate that such well-established technique can also be used to measure the orbital angular momentum of ultrashort Laguerre-Gauss (LG) pulses. By analysing the far-field pattern of the SHG signal, the full spatial structure of ultrashort LG pulses, including both azimuthal and radial indices, are unambiguously determined. Our results provide an important advancement for the well-established autocorrelation technique by extending it to reach its full potential in laser characterization, especially for structured ultrashort pulses.


title: Finding Nonlinear Production -- Consumption Equilibrium

abstract: We introduce and study nonlinear production - consumption equilibrium (NPCE). The NPCE is a combination and generalization of both classical linear programming (LP) and classical input-output (IO) models. In contrast to LP and IO the NPCE has both production and consumption components. Moreover, the production cost, the consumption and the factors (resources) availability are not fixed. Instead they are corespondent functions of the production output, prices of goods and prices of factors. At the NPCE the total production cost reaches its minimum, while the total consumption, without factors expences, reaches its maximum. At the same time the production cost is consistent with the production output, the consumption is consistent with the prices for goods and the factors availability is consistent with prices for factors. Finding NPCE is equivalent to solving a variational inequality (VI) with a particular nonlinear operator and a simple feasible set. Under natural assumptions on the production, consumption and factor operators the NPCE exists and it is unique. Projection on the feasible set {\Omega} is a low cost operation, therefore for solving the VI we use two projection methods. Each of them requires at each step few matrix by vector multiplications and allows, along with convergence and convergence rate, establish complexity bound. The methods decompose the problem, so both the primal and the dual variables are computed simultaneously. On the other hand, both methods are pricing mechanisms for establishing NPCE, which is a generalization of Walras - Wald equilibrium (see [12]) in few directions.


title: IDPG: An Instance-Dependent Prompt Generation Method

abstract: Prompt tuning is a new, efficient NLP transfer learning paradigm that adds a task-specific prompt in each input instance during the model training stage. It freezes the pre-trained language model and only optimizes a few task-specific prompts. In this paper, we propose a conditional prompt generation method to generate prompts for each input instance, referred to as the Instance-Dependent Prompt Generation (IDPG). Unlike traditional prompt tuning methods that use a fixed prompt, IDPG introduces a lightweight and trainable component to generate prompts based on each input sentence. Extensive experiments on ten natural language understanding (NLU) tasks show that the proposed strategy consistently outperforms various prompt tuning baselines and is on par with other efficient transfer learning methods such as Compacter while tuning far fewer model parameters.


title: A unified weighted inequality for fourth-order partial differential operators and applications

abstract: In this paper, we establish a fundamental inequality for fourth order partial differential operator $\cal P=\alpha\partial_s+\beta\partial_{ss}+\Delta^2$ ($\alpha, \beta\in\mathbb{R}$) with an abstract exponential-type weight function. Such kind of weight functions including not only the regular weight functions but also the singular weight functions. Using this inequality we are able to prove some Carleman estimates for the operator $\cal P$ with some suitable boundary conditions in the case of $\beta<0$ or $\alpha\neq 0, \beta=0$. As application, we obtain a resolvent estimate for $\cal P$, which can imply a log-type stabilization result for the plate equation with clamped boundary conditions or hinged boundary conditions.


title: Rheological model for the alpha relaxation of glass-forming liquids and its comparison to data for DC704 and DC705

abstract: Dynamic shear-modulus data are presented for the two silicone oils DC704 and DC705 for frequencies between 1 mHz and 10 kHz at temperatures covering more than five decades of relaxation-time variation. The data are fitted to the alpha part of a phenomenological model previously shown to describe well the dynamic shear modulus of squalane, which has a large beta process [Hecksher \textit{et al.}, J. Chem. Phys. \textbf{146}, 154504 (2017)]; that model is characterized by additivity of the alpha and beta shear compliance and by a high-frequency decay of the alpha process in proportion to $\omega^{-1/2}$ in which $\omega$ is the angular frequency. The fits of the alpha part of this model to the DC704 and DC705 data are compared to fits by a Havriliak-Negami type model, the Barlow-Erginsav-Lamb model, and a Cole-Davidson type model. At all temperatures the best fit is obtained by the alpha part of the squalane model. This strengthens the conjecture that so-called $\sqrt{t}$-relaxation, leading to high-frequency decays proportional to $\omega^{-1/2}$, is a general characteristic of the alpha relaxation of supercooled liquids [Dyre, Phys. Rev. E {\bf 74}, 021502 (2006); Nielsen \textit{et al.}, J. Chem. Phys. \textbf{130}, 154508 (2009); Pabst \textit{et al.}, J. Phys. Chem. Lett. \textbf{12}, 3685 (2021)].


title: Faster Min-Plus Product for Monotone Instances

abstract: In this paper, we show that the time complexity of monotone min-plus product of two $n\times n$ matrices is $\tilde{O}(n^{(3+\omega)/2})=\tilde{O}(n^{2.687})$, where $\omega < 2.373$ is the fast matrix multiplication exponent [Alman and Vassilevska Williams 2021]. That is, when $A$ is an arbitrary integer matrix and $B$ is either row-monotone or column-monotone with integer elements bounded by $O(n)$, computing the min-plus product $C$ where $C_{i,j}=\min_k\{A_{i,k}+B_{k,j}\}$ takes $\tilde{O}(n^{(3+\omega)/2})$ time, which greatly improves the previous time bound of $\tilde{O}(n^{(12+\omega)/5})=\tilde{O}(n^{2.875})$ [Gu, Polak, Vassilevska Williams and Xu 2021]. Then by simple reductions, this means the following problems also have $\tilde{O}(n^{(3+\omega)/2})$ time algorithms: (1) $A$ and $B$ are both bounded-difference, that is, the difference between any two adjacent entries is a constant. The previous results give time complexities of $\tilde{O}(n^{2.824})$ [Bringmann, Grandoni, Saha and Vassilevska Williams 2016] and $\tilde{O}(n^{2.779})$ [Chi, Duan and Xie 2022]. (2) $A$ is arbitrary and the columns or rows of $B$ are bounded-difference. Previous result gives time complexity of $\tilde{O}(n^{2.922})$ [Bringmann, Grandoni, Saha and Vassilevska Williams 2016]. (3) The problems reducible to these problems, such as language edit distance, RNA-folding, scored parsing problem on BD grammars. [Bringmann, Grandoni, Saha and Vassilevska Williams 2016]. Finally, we also consider the problem of min-plus convolution between two integral sequences which are monotone and bounded by $O(n)$, and achieve a running time upper bound of $\tilde{O}(n^{1.5})$. Previously, this task requires running time $\tilde{O}(n^{(9+\sqrt{177})/12}) = O(n^{1.859})$ [Chan and Lewenstein 2015].


title: Explain yourself! Effects of Explanations in Human-Robot Interaction

abstract: Recent developments in explainable artificial intelligence promise the potential to transform human-robot interaction: Explanations of robot decisions could affect user perceptions, justify their reliability, and increase trust. However, the effects on human perceptions of robots that explain their decisions have not been studied thoroughly. To analyze the effect of explainable robots, we conduct a study in which two simulated robots play a competitive board game. While one robot explains its moves, the other robot only announces them. Providing explanations for its actions was not sufficient to change the perceived competence, intelligence, likeability or safety ratings of the robot. However, the results show that the robot that explains its moves is perceived as more lively and human-like. This study demonstrates the need for and potential of explainable human-robot interaction and the wider assessment of its effects as a novel research direction.


title: Predicting aggregate morphology of sequence-defined macromolecules with Recurrent Neural Networks

abstract: Self-assembly of dilute sequence-defined macromolecules is a complex phenomenon in which the local arrangement of chemical moieties can lead to the formation of long-range structure. The dependence of this structure on the sequence necessarily implies that a mapping between the two exists, yet it has been difficult to model so far. Predicting the aggregation behavior of these macromolecules is challenging due to the lack of effective order parameters, a vast design space, inherent variability, and high computational costs associated with currently available simulation techniques. Here, we accurately predict the morphology of aggregates self-assembled from sequence-defined macromolecules using supervised machine learning. We find that regression models with implicit representation learning perform significantly better than those based on engineered features such as $k$-mer counting, and a Recurrent-Neural-Network-based regressor performs the best out of nine model architectures we tested. Furthermore, we demonstrate the high-throughput screening of monomer sequences using the regression model to identify candidates for self-assembly into selected morphologies. Our strategy is shown to successfully identify multiple suitable sequences in every test we performed, so we hope the insights gained here can be extended to other increasingly complex design scenarios in the future, such as the design of sequences under polydispersity and at varying environmental conditions.

categories: cond-mat.soft cond-mat.dis-nn cond-mat.mtrl-sci cond-mat.other


title: Role of substrate surface morphology on the performance of graphene inks for flexible electronics

abstract: Two-dimensional (2D) materials, such as graphene, are seen as potential candidates for fabricating electronic devices and circuits on flexible substrates. Inks or dispersions of 2D materials can be deposited on flexible substrates by large-scale coating techniques, such as inkjet printing and spray coating. One of the main issues in coating processes is nonuniform deposition of inks, which may lead to large variations of properties across the substrates. Here, we investigate the role of surface morphology on the performance of graphene ink deposited on different paper substrates with specific top coatings. Substrates with good wetting properties result in reproducible thin films and electrical properties with low sheet resistance. The correct choice of surface morphology enables high-performance films without postdeposition annealing or treatment. Scanning terahertz time-domain spectroscopy (THz-TDS) is introduced to evaluate both the uniformity and the local conductivity of graphene inks on paper. A paper-based strain gauge is demonstrated and a variable resistor acts as an on-off switch for operating an LED. Customized surfaces can thus help in unleashing the full potential of ink-based 2D materials.


title: TANet: Thread-Aware Pretraining for Abstractive Conversational Summarization

abstract: Although pre-trained language models (PLMs) have achieved great success and become a milestone in NLP, abstractive conversational summarization remains a challenging but less studied task. The difficulty lies in two aspects. One is the lack of large-scale conversational summary data. Another is that applying the existing pre-trained models to this task is tricky because of the structural dependence within the conversation and its informal expression, etc. In this work, we first build a large-scale (11M) pretraining dataset called RCS, based on the multi-person discussions in the Reddit community. We then present TANet, a thread-aware Transformer-based network. Unlike the existing pre-trained models that treat a conversation as a sequence of sentences, we argue that the inherent contextual dependency among the utterances plays an essential role in understanding the entire conversation and thus propose two new techniques to incorporate the structural information into our model. The first is thread-aware attention which is computed by taking into account the contextual dependency within utterances. Second, we apply thread prediction loss to predict the relations between utterances. We evaluate our model on four datasets of real conversations, covering types of meeting transcripts, customer-service records, and forum threads. Experimental results demonstrate that TANET achieves a new state-of-the-art in terms of both automatic evaluation and human judgment.


title: Kolmogorov Turbulence Coexists with Pseudo-Turbulence in Buoyancy-Driven Bubbly Flows

abstract: We investigate spectral properties of buoyancy driven bubbly flows. Using high-resolution numerical simulations and phenomenology of homogeneous turbulence, we identify the relevant energy transfer mechanisms. We find: (a) At high enough Galilei number (ratio of the buoyancy to viscous forces) the kinetic energy spectrum shows the Kolmogorov scaling with a power law exponent $-5/3$ for the range of scales between the bubble diameter and the dissipation scale ($\eta$). (b) For scales smaller than $\eta$, the physics of pseudo-turbulence is recovered.


title: Dark energy and accelerating cosmological evolution from osculating Barthel-Kropina geometry

abstract: Finsler geometry is an important extension of Riemann geometry, in which to each point of the spacetime manifold an arbitrary internal variable is associated. Interesting Finsler geometries, with many physical applications, are the Randers and Kropina type geometries, respectively. A subclass of Finsler geometries is represented by the osculating Finsler spaces, in which the internal variable is a function of the base manifold coordinates only. In an osculating Finsler geometry one introduces the Barthel connection, which has the remarkable property that it is the Levi-Civita connection of a Riemannian metric. In the present work we consider the gravitational and cosmological implications of a Barthel-Kropina type geometry. We assume that in this geometry the Ricci type curvatures are related to the matter energy-momentum tensor by the standard Einstein equations. The generalized Friedmann equations in the Barthel-Kropina geometry are obtained by considering that the background Riemannian metric is of Friedmann-Lemaitre-Robertson-Walker type. The matter energy balance equation is also derived. The cosmological properties of the model are investigated in detail, and it is shown that the model admits a de Sitter type solution, and that an effective dark energy component can also be generated. Several cosmological solutions are also obtained by numerically integrating the generalized Friedmann equations. A comparison of two specific classes of models with the observational data and with the standard $\Lambda$CDM model is also performed, and it turns out that the Barthel-Kropina type models give a satisfactory description of the observations.


title: MR-iNet Gym: Framework for Edge Deployment of Deep Reinforcement Learning on Embedded Software Defined Radio

abstract: Dynamic resource allocation plays a critical role in the next generation of intelligent wireless communication systems. Machine learning has been leveraged as a powerful tool to make strides in this domain. In most cases, the progress has been limited to simulations due to the challenging nature of hardware deployment of these solutions. In this paper, for the first time, we design and deploy deep reinforcement learning (DRL)-based power control agents on the GPU embedded software defined radios (SDRs). To this end, we propose an end-to-end framework (MR-iNet Gym) where the simulation suite and the embedded SDR development work cohesively to overcome real-world implementation hurdles. To prove feasibility, we consider the problem of distributed power control for code-division multiple access (DS-CDMA)-based LPI/D transceivers. We first build a DS-CDMA ns3 module that interacts with the OpenAI Gym environment. Next, we train the power control DRL agents in this ns3-gym simulation environment in a scenario that replicates our hardware testbed. Next, for edge (embedded on-device) deployment, the trained models are optimized for real-time operation without loss of performance. Hardware-based evaluation verifies the efficiency of DRL agents over traditional distributed constrained power control (DCPC) algorithm. More significantly, as the primary goal, this is the first work that has established the feasibility of deploying DRL to provide optimized distributed resource allocation for next-generation of GPU-embedded radios.


title: Finding the Right Place: Sensor Placement for UWB Time Difference of Arrival Localization in Cluttered Indoor Environments

abstract: Ultra-wideband (UWB) time difference of arrival (TDOA)-based localization has recently emerged as a promising indoor positioning solution. However, in cluttered environments, both the UWB radio positions and the obstacle-induced non-line-of-sight (NLOS) measurement biases significantly impact the quality of the position estimate. Consequently, the placement of the UWB radios must be carefully designed to provide satisfactory localization accuracy for a region of interest. In this work, we propose a novel algorithm that optimizes the UWB radio positions for a pre-defined region of interest in the presence of obstacles. The mean-squared error (MSE) metric is used to formulate an optimization problem that balances the influence of the geometry of the radio positions and the NLOS effects. We further apply the proposed algorithm to compute a minimal number of UWB radios required for a desired localization accuracy and their corresponding positions. In a real-world cluttered environment, we show that the designed UWB radio placements provide 47% and 76% localization root-mean-squared error (RMSE) reduction in 2D and 3D experiments, respectively, when compared against trivial placements.


title: Graphene coating of Nafion$^{(R)}$ membranes for enhanced fuel cell performance

abstract: Electrochemically exfoliated graphene (e-G) thin films on Nafion$^{(R)}$ membranes exhibit a selective barrier effect against undesirable fuel crossover. The approach combines the high proton conductivity of state-of-the-art Nafion$^{(R)}$ and the ability of e-G layers to effectively block the transport of methanol and hydrogen. Nafion$^{(R)}$ membranes are coated with aqueous dispersions of e-G on the anode side, making use of a facile and scalable spray process. Scanning transmission electron microscopy (STEM) and electron energy-loss spectroscopy (EELS) confirm the formation of a dense percolated graphene flake network which acts as diffusion barrier. The maximum power density in direct methanol fuel cell (DMFC) operation with e-G coated Nafion$^{(R)}$ N115 is 3.9 times higher than the Nafion$^{(R)}$ N115 reference (39 vs. 10 mW cm$^{-2}$ @ 0.3 V) at 5M methanol feed concentration. This suggests the application of e-G coated Nafion$^{(R)}$ membranes for portable DMFCs, where the use of highly concentrated methanol is desirable.


title: Translating Subgraphs to Nodes Makes Simple GNNs Strong and Efficient for Subgraph Representation Learning

abstract: Subgraph representation learning has emerged as an important problem, but it is by default approached with specialized graph neural networks on a large global graph. These models demand extensive memory and computational resources but challenge modeling hierarchical structures of subgraphs. In this paper, we propose Subgraph-To-Node (S2N) translation, a novel formulation for learning representations of subgraphs. Specifically, given a set of subgraphs in the global graph, we construct a new graph by coarsely transforming subgraphs into nodes. Demonstrating both theoretical and empirical evidence, S2N not only significantly reduces memory and computational costs compared to state-of-the-art models but also outperforms them by capturing both local and global structures of the subgraph. By leveraging graph coarsening methods, our method outperforms baselines even in a data-scarce setting with insufficient subgraphs. Our experiments on eight benchmarks demonstrate that fined-tuned models with S2N translation can process 183 -- 711 times more subgraph samples than state-of-the-art models at a better or similar performance level.


title: FuNNscope: Visual microscope for interactively exploring the loss landscape of fully connected neural networks

abstract: Despite their effective use in various fields, many aspects of neural networks are poorly understood. One important way to investigate the characteristics of neural networks is to explore the loss landscape. However, most models produce a high-dimensional non-convex landscape which is difficult to visualize. We discuss and extend existing visualization methods based on 1D- and 2D slicing with a novel method that approximates the actual loss landscape geometry by using charts with interpretable axes. Based on the assumption that observations on small neural networks can generalize to more complex systems and provide us with helpful insights, we focus on small models in the range of a few dozen weights, which enables computationally cheap experiments and the use of an interactive dashboard. We observe symmetries around the zero vector, the influence of different layers on the global landscape, the different weight sensitivities around a minimizer, and how gradient descent navigates high-loss obstacles. The user study resulted in an average SUS (System Usability Scale) score with suggestions for improvement and opened up a number of possible application scenarios, such as autoencoders and ensemble networks.


title: Spectral bounds of the $\varepsilon$-entropy of kernel classes

abstract: We develop new upper and lower bounds on the $\varepsilon$-entropy of a unit ball in a reproducing kernel Hilbert space induced by some Mercer kernel $K$. Our bounds are based on the behaviour of eigenvalues of a corresponding integral operator. In our approach we exploit an ellipsoidal structure of a unit ball in RKHS and a previous work on covering numbers of an ellipsoid in the euclidean space obtained by Dumer, Pinsker and Prelov. We present a number of applications of our main bound, such as its tightness for a practically important case of the Gaussian kernel. Further, we develop a series of lower bounds on the $\varepsilon$-entropy that can be established from a connection between covering numbers of a ball in RKHS and a quantization of a Gaussian Random Field that corresponds to the kernel $K$ by the Kosambi-Karhunen-Lo\`eve transform.


title: On the Exploitation of Deepfake Model Recognition

abstract: Despite recent advances in Generative Adversarial Networks (GANs), with special focus to the Deepfake phenomenon there is no a clear understanding neither in terms of explainability nor of recognition of the involved models. In particular, the recognition of a specific GAN model that generated the deepfake image compared to many other possible models created by the same generative architecture (e.g. StyleGAN) is a task not yet completely addressed in the state-of-the-art. In this work, a robust processing pipeline to evaluate the possibility to point-out analytic fingerprints for Deepfake model recognition is presented. After exploiting the latent space of 50 slightly different models through an in-depth analysis on the generated images, a proper encoder was trained to discriminate among these models obtaining a classification accuracy of over 96%. Once demonstrated the possibility to discriminate extremely similar images, a dedicated metric exploiting the insights discovered in the latent space was introduced. By achieving a final accuracy of more than 94% for the Model Recognition task on images generated by models not employed in the training phase, this study takes an important step in countering the Deepfake phenomenon introducing a sort of signature in some sense similar to those employed in the multimedia forensics field (e.g. for camera source identification task, image ballistics task, etc).


title: The W boson mass weighs in on the non-standard Higgs

abstract: We consider the implications of the CDF collaboration high-precision measurement of the W boson mass on models with a non-standard Higgs. We show that this requires an enhancement of 3-10% in the non-standard Higgs coupling to the gauge bosons. This is naturally accommodated in dynamical models such as the dilaton Higgs, the Technicolor and glueball Higgs. The needed composite scale between 2 and 3 TeV can also explain the muon g-2 anomaly, as well as possible violations of lepton flavour universality.


title: Applying machine learning to predict behavior of bus transport in Warsaw, Poland

abstract: Nowadays, it is possible to collect precise data describing movements of public transport. Specifically, for each bus (or tram) geoposition data can be regularly collected. This includes data for all buses in Warsaw, Poland. Moreover, this data can be downloaded and analyzed. In this context, one of the simplest questions is: can a model be build to represent behavior of busses, and predict their delays. This work provides initial results of our attempt to answer this question.


title: Uncertainty-Informed Deep Learning Models Enable High-Confidence Predictions for Digital Histopathology

abstract: A model's ability to express its own predictive uncertainty is an essential attribute for maintaining clinical user confidence as computational biomarkers are deployed into real-world medical settings. In the domain of cancer digital histopathology, we describe a novel, clinically-oriented approach to uncertainty quantification (UQ) for whole-slide images, estimating uncertainty using dropout and calculating thresholds on training data to establish cutoffs for low- and high-confidence predictions. We train models to identify lung adenocarcinoma vs. squamous cell carcinoma and show that high-confidence predictions outperform predictions without UQ, in both cross-validation and testing on two large external datasets spanning multiple institutions. Our testing strategy closely approximates real-world application, with predictions generated on unsupervised, unannotated slides using predetermined thresholds. Furthermore, we show that UQ thresholding remains reliable in the setting of domain shift, with accurate high-confidence predictions of adenocarcinoma vs. squamous cell carcinoma for out-of-distribution, non-lung cancer cohorts.


title: The spin-one Motzkin chain is gapped for any area weight $t<1$

abstract: We prove a conjecture by Zhang, Ahmadain, and Klich that the spin-$1$ Motzkin chain is gapped for any area weight $t<1$. Existence of a finite spectral gap is necessary for the Motzkin Hamiltonian to belong to the Haldane phase, which has been argued to potentially be the case in recent work of Barbiero, Dell'Anna, Trombettoni, and Korepin. Our proof rests on the combinatorial structure of the ground space and the analytical verification of a finite-size criterion.

categories: quant-ph cond-mat.stat-mech math-ph math.MP


title: Attention U-Net as a surrogate model for groundwater prediction

abstract: Numerical simulations of groundwater flow are used to analyze and predict the response of an aquifer system to its change in state by approximating the solution of the fundamental groundwater physical equations. The most used and classical methodologies, such as Finite Difference (FD) and Finite Element (FE) Methods, use iterative solvers which are associated with high computational cost. This study proposes a physics-based convolutional encoder-decoder neural network as a surrogate model to quickly calculate the response of the groundwater system. Holding strong promise in cross-domain mappings, encoder-decoder networks are applicable for learning complex input-output mappings of physical systems. This manuscript presents an Attention U-Net model that attempts to capture the fundamental input-output relations of the groundwater system and generates solutions of hydraulic head in the whole domain given a set of physical parameters and boundary conditions. The model accurately predicts the steady state response of a highly heterogeneous groundwater system given the locations and piezometric head of up to 3 wells as input. The network learns to pay attention only in the relevant parts of the domain and the generated hydraulic head field corresponds to the target samples in great detail. Even relative to coarse finite difference approximations the proposed model is shown to be significantly faster than a comparative state-of-the-art numerical solver, thus providing a base for further development of the presented networks as surrogate models for groundwater prediction.


title: Deflection and Gravitational lensing of null and timelike signals in the Kiselev black hole spacetime in the weak field limit

abstract: In this work we study the deflection and gravitational lensing of null and timelike signals in the Kiselev spacetime in the weak field limit, to investigate the effects of the equation of state parameter $\omega$ and the matter amount parameter $\alpha$. In doing this, we extend a perturbative method previously developed for asymptotically flat spacetimes whose metric functions have integer-power asymptotic expansions to the case that may or may not be asymptotically flat but with non-integer power expansions. It is found that in the asymptotically flat case ($-1/3<\omega<0$) the deflection angles are expressable as quasi-power series of the dimensionless quantities $M/b,~b/r_{s,d}$ and $\alpha/M^{1+3\omega}$ where $M,~b,~r_{s,d}$ are respectively the lens mass, impact parameter and source/detector radius. A similar series exists for the non-asymptotically flat case of ($-1<\omega<-1/3$), but with the closest radius $r_0$ replacing $b$. In the asymptotically flat (or non-flat) case, the increase of $\alpha$ or decrease of $\omega$ will increase (or increase) the deflection angle. Since the obtained deflection angles naturally take into account the finite distance effect of the source and the detector, we can establish an exact gravitational lensing equation, from which the apparent angles of the images and their magnifications are solved. It is found that generally for the asymptotically flat case, increasing $\alpha$ or decreasing $\omega$ will increase the apparent angles of the images. While for the non-asymptotically flat case, increasing $\alpha$ or $\omega$ will both lead to smaller apparent angles.


title: A generalized Hopfield model to store and retrieve mismatched memory patterns

abstract: We study a class of Hopfield models where the memories are represented by a mixture of Gaussian and binary variables and the neurons are Ising spins. We study the properties of this family of models as the relative weight of the two kinds of variables in the patterns varies. We quantitatively determine how the retrieval phase squeezes towards zero as the memory patterns contain a larger fraction of mismatched variables. As the memory is purely Gaussian retrieval is lost for any positive storage capacity. It is shown that this comes about because of the spherical symmetry of the free energy in the Gaussian case. Introducing two different memory pattern overlaps between spin configurations and each contribution to the pattern from the two kinds of variables one can observe that the Gaussian parts of the patterns act as a noise, making retrieval more difficult. The basins of attraction of the states, the accuracy of the retrieval and the storage capacity are studied by means of Monte Carlo numerical simulations. We uncover that even in the limit where the network capacity shrinks to zero, the (few) retrieval states maintain a large basin of attraction and large overlaps with the mismatched patterns. So the network can be used for retrieval, but with a very small capacity.


title: Benchmarking for Public Health Surveillance tasks on Social Media with a Domain-Specific Pretrained Language Model

abstract: A user-generated text on social media enables health workers to keep track of information, identify possible outbreaks, forecast disease trends, monitor emergency cases, and ascertain disease awareness and response to official health correspondence. This exchange of health information on social media has been regarded as an attempt to enhance public health surveillance (PHS). Despite its potential, the technology is still in its early stages and is not ready for widespread application. Advancements in pretrained language models (PLMs) have facilitated the development of several domain-specific PLMs and a variety of downstream applications. However, there are no PLMs for social media tasks involving PHS. We present and release PHS-BERT, a transformer-based PLM, to identify tasks related to public health surveillance on social media. We compared and benchmarked the performance of PHS-BERT on 25 datasets from different social medial platforms related to 7 different PHS tasks. Compared with existing PLMs that are mainly evaluated on limited tasks, PHS-BERT achieved state-of-the-art performance on all 25 tested datasets, showing that our PLM is robust and generalizable in the common PHS tasks. By making PHS-BERT available, we aim to facilitate the community to reduce the computational cost and introduce new baselines for future works across various PHS-related tasks.