title: Learning Dependencies in Distributed Cloud Applications to Identify and Localize Anomalies

abstract: Operation and maintenance of large distributed cloud applications can quickly become unmanageably complex, putting human operators under immense stress when problems occur. Utilizing machine learning for identification and localization of anomalies in such systems supports human experts and enables fast mitigation. However, due to the various inter-dependencies of system components, anomalies do not only affect their origin but propagate through the distributed system. Taking this into account, we present Arvalus and its variant D-Arvalus, a neural graph transformation method that models system components as nodes and their dependencies and placement as edges to improve the identification and localization of anomalies. Given a series of metric KPIs, our method predicts the most likely system state - either normal or an anomaly class - and performs localization when an anomaly is detected. During our experiments, we simulate a distributed cloud application deployment and synthetically inject anomalies. The evaluation shows the generally good prediction performance of Arvalus and reveals the advantage of D-Arvalus which incorporates information about system component dependencies.


title: Mixed multifractal densities for quasi-Ahlfors vector-valued measures

abstract: In the present work, some density estimations associated with vector-valued quasi-Ahlfors measures are developed within the mixed multifractal analysis framework. The principle idea based on the fact that being quasi-Ahlfors is sufficient to conduct a mixed multifractal analysis for vector-valued measures. In the present work, we introduced a multifractal density for finitely many measures and showed that such density may be estimated well by means of the mixed multifractal measures. Such estimation induces an exact computation of the multifractal spectrum of the vector-valued quasi-Ahlfors measure.


title: Pretrained Transformers as Universal Computation Engines

abstract: We investigate the capability of a transformer pretrained on natural language to generalize to other modalities with minimal finetuning -- in particular, without finetuning of the self-attention and feedforward layers of the residual blocks. We consider such a model, which we call a Frozen Pretrained Transformer (FPT), and study finetuning it on a variety of sequence classification tasks spanning numerical computation, vision, and protein fold prediction. In contrast to prior works which investigate finetuning on the same modality as the pretraining dataset, we show that pretraining on natural language can improve performance and compute efficiency on non-language downstream tasks. Additionally, we perform an analysis of the architecture, comparing the performance of a random initialized transformer to a random LSTM. Combining the two insights, we find language-pretrained transformers can obtain strong performance on a variety of non-language tasks.


title: Practical Relative Order Attack in Deep Ranking

abstract: Recent studies unveil the vulnerabilities of deep ranking models, where an imperceptible perturbation can trigger dramatic changes in the ranking result. While previous attempts focus on manipulating absolute ranks of certain candidates, the possibility of adjusting their relative order remains under-explored. In this paper, we formulate a new adversarial attack against deep ranking systems, i.e., the Order Attack, which covertly alters the relative order among a selected set of candidates according to an attacker-specified permutation, with limited interference to other unrelated candidates. Specifically, it is formulated as a triplet-style loss imposing an inequality chain reflecting the specified permutation. However, direct optimization of such white-box objective is infeasible in a real-world attack scenario due to various black-box limitations. To cope with them, we propose a Short-range Ranking Correlation metric as a surrogate objective for black-box Order Attack to approximate the white-box method. The Order Attack is evaluated on the Fashion-MNIST and Stanford-Online-Products datasets under both white-box and black-box threat models. The black-box attack is also successfully implemented on a major e-commerce platform. Comprehensive experimental evaluations demonstrate the effectiveness of the proposed methods, revealing a new type of ranking model vulnerability.


title: Negative Imaginary State Feedback Equivalence for Systems of Relative Degree One and Relative Degree Two

abstract: This paper presents necessary and sufficient conditions under which a linear system of relative degree either one or two is state feedback equivalent to a negative imaginary (NI) system. More precisely, we show for a class of linear time-invariant strictly proper systems, that such a system can be rendered minimal and NI using full state feedback if and only if it is controllable and weakly minimum phase. A strongly strict negative imaginary state feedback equivalence result is also provided. The NI state feedback equivalence result is then applied in a robust stabilization problem for an uncertain system with a strictly negative imaginary uncertainty.


title: ByteSGAN: A Semi-supervised Generative Adversarial Network for Encrypted Traffic Classification of SDN Edge Gateway in Green Communication Network

abstract: With the rapid development of Green Communication Network, the types and quantity of network traffic data are accordingly increasing. Network traffic classification become a non-trivial research task in the area of network management and security, which not only help to improve the fine-grained network resource allocation, but also enable policy-driven network management. Meanwhile, the combination of SDN and Edge Computing can leverage both SDN at its global visiability of network-wide and Edge Computing at its low latency and good privacy-preserving. However, capturing large labeled datasets is a cumbersome and time-consuming manual labor. Semi-Supervised learning is an appropriate technique to overcome this problem. With that in mind, we proposed a Generative Adversarial Network (GAN)-based Semi-Supervised Learning Encrypted Traffic Classification method called \emph{ByteSGAN} embedded in SDN Edge Gateway to achieve the goal of traffic classification in a fine-grained manner to further improve network resource utilization. ByteSGAN can only use a small number of labeled traffic samples and a large number of unlabeled samples to achieve a good performance of traffic classification by modifying the structure and loss function of the regular GAN discriminator network in a semi-supervised learning way. Based on public dataset 'ISCX2012 VPN-nonVPN', two experimental results show that the ByteSGAN can efficiently improve the performance of traffic classifier and outperform the other supervised learning method like CNN.


title: Enhancing sensor resolution improves CNN accuracy given the same number of parameters or FLOPS

abstract: High image resolution is critical to obtain a good performance in many computer vision applications. Computational complexity of CNNs, however, grows significantly with the increase in input image size. Here, we show that it is almost always possible to modify a network such that it achieves higher accuracy at a higher input resolution while having the same number of parameters or/and FLOPS. The idea is similar to the EfficientNet paper but instead of optimizing network width, depth and resolution simultaneously, here we focus only on input resolution. This makes the search space much smaller which is more suitable for low computational budget regimes. More importantly, by controlling for the number of model parameters (and hence model capacity), we show that the additional benefit in accuracy is indeed due to the higher input resolution. Preliminary empirical investigation over MNIST, Fashion MNIST, and CIFAR10 datasets demonstrates the efficiency of the proposed approach.


title: Implementation of Departmental and Periodical Examination Analyzer System

abstract: Administering examinations both in public and private academic institutions can be tedious and unmanageable. The multiplicity of problems affecting the conduct of departmental and periodical examination can be greatly reduced by automating the examination process. The purpose of this action research is to provide an alternative technical solution in administering test through the use of Examination System. This software application can facilitate a plenitude of examinees for different subjects that implements a random questioning technique and can generate item analysis and test results. The Departmental and Periodical Examination System was developed using Visual Basic language. The software modules were tested using the functional testing method. Using the criteria and metrics of ISO 9126 software quality model, the system was evaluated by a group of students, teachers, school administrators and information technology professionals and has received an overall weighted mean of 4.56585 with an excellent descriptive rating. Therefore, the performance of the application software provides solution that can surmount the gargantuan problems of test administration and post-examination issues and performs all the operations specified in the objectives.


title: Polariton blockade in the Jaynes-Cummings-Hubbard model with trapped ions

abstract: We have experimentally observed the dynamics of a single polariton and two polaritons in a two-ion chain. By driving two trapped ions at a motional blue-sideband transition, we realize the anti-Jaynes-Cummings-Hubbard model. When a single polariton exists in a trapped-ion chain, the polariton hops between the ion sites. On the other hand, when there are single polaritons at each ion site, the hopping of the polaritons is suppressed because of the polariton-polariton interaction induced by the nonlinearity of the anti-Jaynes-Cummings interaction, thereby realizing the blockade of polariton hopping in the anti-Jaynes-Cummings-Hubbard model with trapped ions. Our work is a step towards the development of a trapped-ion based quantum simulator for strongly interacting polaritonic systems.


title: MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentation

abstract: Unsupervised domain adaptation (UDA) aims to transfer the knowledge from the labeled source domain to the unlabeled target domain. Existing self-training based UDA approaches assign pseudo labels for target data and treat them as ground truth labels to fully leverage unlabeled target data for model adaptation. However, the generated pseudo labels from the model optimized on the source domain inevitably contain noise due to the domain gap. To tackle this issue, we advance a MetaCorrection framework, where a Domain-aware Meta-learning strategy is devised to benefit Loss Correction (DMLC) for UDA semantic segmentation. In particular, we model the noise distribution of pseudo labels in target domain by introducing a noise transition matrix (NTM) and construct meta data set with domain-invariant source data to guide the estimation of NTM. Through the risk minimization on the meta data set, the optimized NTM thus can correct the noisy issues in pseudo labels and enhance the generalization ability of the model on the target data. Considering the capacity gap between shallow and deep features, we further employ the proposed DMLC strategy to provide matched and compatible supervision signals for different level features, thereby ensuring deep adaptation. Extensive experimental results highlight the effectiveness of our method against existing state-of-the-art methods on three benchmarks.


title: Improving Generalizability in Limited-Angle CT Reconstruction with Sinogram Extrapolation

abstract: Computed tomography (CT) reconstruction from X-ray projections acquired within a limited angle range is challenging, especially when the angle range is extremely small. Both analytical and iterative models need more projections for effective modeling. Deep learning methods have gained prevalence due to their excellent reconstruction performances, but such success is mainly limited within the same dataset and does not generalize across datasets with different distributions. Hereby we propose ExtraPolationNetwork for limited-angle CT reconstruction via the introduction of a sinogram extrapolation module, which is theoretically justified. The module complements extra sinogram information and boots model generalizability. Extensive experimental results show that our reconstruction model achieves state-of-the-art performance on NIH-AAPM dataset, similar to existing approaches. More importantly, we show that using such a sinogram extrapolation module significantly improves the generalization capability of the model on unseen datasets (e.g., COVID-19 and LIDC datasets) when compared to existing approaches.


title: CEQE: Contextualized Embeddings for Query Expansion

abstract: In this work we leverage recent advances in context-sensitive language models to improve the task of query expansion. Contextualized word representation models, such as ELMo and BERT, are rapidly replacing static embedding models. We propose a new model, Contextualized Embeddings for Query Expansion (CEQE), that utilizes query-focused contextualized embedding vectors. We study the behavior of contextual representations generated for query expansion in ad-hoc document retrieval. We conduct our experiments on probabilistic retrieval models as well as in combination with neural ranking models. We evaluate CEQE on two standard TREC collections: Robust and Deep Learning. We find that CEQE outperforms static embedding-based expansion methods on multiple collections (by up to 18% on Robust and 31% on Deep Learning on average precision) and also improves over proven probabilistic pseudo-relevance feedback (PRF) models. We further find that multiple passes of expansion and reranking result in continued gains in effectiveness with CEQE-based approaches outperforming other approaches. The final model incorporating neural and CEQE-based expansion score achieves gains of up to 5% in P@20 and 2% in AP on Robust over the state-of-the-art transformer-based re-ranking model, Birch.


title: Production of $P_{cs}(4459)$ from $\Xi_b$ decay

abstract: Inspired by the $P_{cs}(4459)$ reported by the LHCb collaboration recently, we investigate the $P_{cs}(4459)$ production from $\Xi_b$ decay in a molecular scenario using an effective Lagrangian approach. With different $J^P$ assignments to $P_{cs}(4459)$, the magnitude of branching fractions of $\Xi_b \to P_{cs}(4459) K$ is estimated, which is of the order of $10^{-4}$. Together with the decay properties of $P_{cs}(4459)$, the present estimations could be further testified by precise measurements and contribute to a better understanding of the molecular interpretations and the exploration of $J^P$ quantum numbers of $P_{cs}(4459)$.


title: Brittle to ductile transitions in glasses: Roles of soft defects and loading geometry

abstract: Understanding the fracture toughness of glasses is of prime importance for science and technology. We study it here using extensive atomistic simulations in which the interaction potential, glass transition cooling rate and loading geometry are systematically varied, mimicking a broad range of experimentally accessible properties. Glasses' nonequilibrium mechanical disorder is quantified through $A_{\rm g}$, the dimensionless prefactor of the universal spectrum of nonphononic excitations, which measures the abundance of soft glassy defects that affect plastic deformability. We show that while a brittle-to-ductile transition might be induced by reducing the cooling rate, leading to a reduction in $A_{\rm g}$, iso-$\!A_{\rm g}$ glasses are either brittle or ductile depending on the degree of Poisson contraction under unconstrained uniaxial tension. Eliminating Poisson contraction using constrained tension reveals that iso-$\!A_{\rm g}$ glasses feature similar toughness, and that varying $A_{\rm g}$ under these conditions results in significant toughness variation. Our results highlight the roles played by both soft defects and loading geometry (which affects the activation of defects) in the toughness of glasses.


title: 2D histology meets 3D topology: Cytoarchitectonic brain mapping with Graph Neural Networks

abstract: Cytoarchitecture describes the spatial organization of neuronal cells in the brain, including their arrangement into layers and columns with respect to cell density, orientation, or presence of certain cell types. It allows to segregate the brain into cortical areas and subcortical nuclei, links structure with connectivity and function, and provides a microstructural reference for human brain atlases. Mapping boundaries between areas requires to scan histological sections at microscopic resolution. While recent high-throughput scanners allow to scan a complete human brain in the order of a year, it is practically impossible to delineate regions at the same pace using the established gold standard method. Researchers have recently addressed cytoarchitectonic mapping of cortical regions with deep neural networks, relying on image patches from individual 2D sections for classification. However, the 3D context, which is needed to disambiguate complex or obliquely cut brain regions, is not taken into account. In this work, we combine 2D histology with 3D topology by reformulating the mapping task as a node classification problem on an approximate 3D midsurface mesh through the isocortex. We extract deep features from cortical patches in 2D histological sections which are descriptive of cytoarchitecture, and assign them to the corresponding nodes on the 3D mesh to construct a large attributed graph. By solving the brain mapping problem on this graph using graph neural networks, we obtain significantly improved classification results. The proposed framework lends itself nicely to integration of additional neuroanatomical priors for mapping.


title: On the regularity of scalar type spectral $C_0$-semigroups

abstract: We show that, for the $C_0$-semigroups of scalar type spectral operators, a well-known necessary condition for the generation of eventually norm-continuous $C_0$-semigroups, formulated exclusively in terms of the location of the spectrum of the semigroup's generator in the complex plane, is also sufficient and, in fact, characterizes the generators of immediately norm-continuous such semigroups. Combining characterizations of the immediate differentiability and the Gevrey ultradifferentiability of scalar type spectral $C_0$-semigroups with the generation theorem, found earlier by the author, we arrive at respective characterizations of the generation of such semigroups. We further establish characterizations of the generation of eventually differentiable and immediately compact scalar type spectral $C_0$-semigroups also in terms of the generator's spectrum and show that, for such semigroups, eventual compactness implies immediate. All the obtained results are instantly transferred to the $C_0$-semigroups of normal operators.


title: Slip flow regimes in nanofluidics: a universal superexponential model

abstract: Many experiments have shown large flow enhancement ratios (up to 10^5) in carbon nanotubes (CNT) with diameters larger than 5nm. However, molecular dynamics simulations have never replicated these results maintaining a three-order-of-magnitude gap with measurements. Our study provides a generic model of nanofluidics for continuum slip flow (diameter>3nm) that fills this significant gap and sheds light on its origin. Compared to 140 literature cases, the model explains the entire range of experimental flow enhancements by changes of nanotube diameters and finite variations of interfacial energies. Despite large variations of flow enhancement ratios spanning 5 orders of magnitude in experimental results, the ratio between these data and corresponding model predictions approaches unity for the majority of experiments. The role of viscous entrance effects is discussed. The model provides insight into puzzling observations such as differences of CNTs and boron nitride nanotubes, the slip on low-contact-angle surfaces and massive functionalization effects. This study could advance our understanding of nano-scale transport mechanisms and aid the design of tailored nanomembranes.


title: Left-Truncated Health Insurance Claims Data: Theoretical Review and Empirical Application

abstract: At the beginning of 2004, we draw a sample of size 0.25 million people from the inventory of the health insurer AOK. We followed their health claims until 2013. Our aim is the effect a stroke on the dementia onset probability, for Germans born in the first half of the 20$^{th}$ century. People deceased before 2004 are randomly left-truncated. Filtrations, modelling the missing data, enable to circumvent the unknown number of truncated persons by using a conditional instead of the full likelihood. Dementia onset after 2013 is a conditionally fixed right-censoring event. For each observed health history, Jacod's formula yields the conditional likelihood contribution. Asymptotic normality of the estimated intensities is derived, relative to a sample size definition that includes the truncated people. Yet, the standard error is observable. The claims data reveal that after a stroke, with time measured in years, the intensity of dementia onset increases from 0.02 to 0.07. Using the independence of the two estimated intensities, a 95\%-confidence interval for their difference is [0.050,0.056]. The effect halves, when we extend the analysis to an age-inhomogeneous model, but does not change further when we additionally adjust for multi-morbidity.


title: Red supergiants in M31 and M33 II. The Mass Loss Rate

abstract: Mass loss is an important activity for red supergiants (RSGs) which can influence their evolution and final fate. Previous estimations of mass loss rates (MLRs) of RSGs exhibit significant dispersion due to the difference in method and the incompleteness of sample. With the improved quality and depth of the surveys including the UKIRT/WFCAM observation in near infrared, LGGS and PS1 in optical, a rather complete sample of RSGs is identified in M31 and M33 according to their brightness and colors. For about 2000 objects in either galaxy from this ever largest sample, the MLR is derived by fitting the observational optical-to-mid infrared spectral energy distribution (SED) with the DUSTY code of a 1-D dust radiative transfer model. The average MLR of RSGs is found to be around $2.0\times10^{-5}{\text{M}_\odot}/\text{yr}$ with a gas-to-dust ratio of 100, which yields a total contribution to the interstellar dust by RSGs of about $1.1\times10^{-3}{\text{M}_\odot}/\text{yr}$ in M31 and $6.0 \times10^{-4}{\text{M}_\odot}/\text{yr}$ in M33, a non-negligible source in comparison with evolved low-mass stars. The MLRs are divided into three types by the dust properties, i.e. amorphous silicate, amorphous carbon and optically thin, and the relations of MLR with stellar parameters, infrared flux and colors are discussed and compared with previous works for the silicate and carbon dust group respectively.


title: Parametric Estimation for Processes Driven by Infinite Dimensional Mixed Fractional Brownian Motion

abstract: Parametric and nonparametric inference for stochastic processes driven by a fractional Brownian motion were investigated in Mishura (2008) and Prakasa Rao(2010) among others. Similar problems for processes driven by an infinite dimensional fractional Brownian motion were studied in Prakasa Rao (2004,2013), Cialenco (2009) and others. Parametric estimation for processes driven by infinite dimensional mixed fractional Brownian motion is discussed in this article.


title: Accelerator Development at the FREIA Laboratory

abstract: The FREIA Laboratory at Uppsala University focuses on superconducting technology and accelerator development. It actively supports the development of the European Spallation Source, CERN, and MAX IV, among others. FREIA has developed test facilities for superconducting accelerator technology such as a double-cavity horizontal test cryostat, a vertical cryostat with a novel magnetic field compensation scheme, and a test stand for short cryomodules. Accelerating cavities have been tested in the horizontal cryostat, crab-cavities in the vertical cryostat, and cryomodules for ESS on the cryomodule test stand. High power radio-frequency amplifier prototypes based on vacuum tube technology were developed for driving spoke cavities. Solid-state amplifiers and power combiners are under development for future projects. We present the status of the FREIA Laboratory complemented with results of recent projects and future prospects.


title: BASAR:Black-box Attack on Skeletal Action Recognition

abstract: Skeletal motion plays a vital role in human activity recognition as either an independent data source or a complement. The robustness of skeleton-based activity recognizers has been questioned recently, which shows that they are vulnerable to adversarial attacks when the full-knowledge of the recognizer is accessible to the attacker. However, this white-box requirement is overly restrictive in most scenarios and the attack is not truly threatening. In this paper, we show that such threats do exist under black-box settings too. To this end, we propose the first black-box adversarial attack method BASAR. Through BASAR, we show that adversarial attack is not only truly a threat but also can be extremely deceitful, because on-manifold adversarial samples are rather common in skeletal motions, in contrast to the common belief that adversarial samples only exist off-manifold. Through exhaustive evaluation and comparison, we show that BASAR can deliver successful attacks across models, data, and attack modes. Through harsh perceptual studies, we show that it achieves effective yet imperceptible attacks. By analyzing the attack on different activity recognizers, BASAR helps identify the potential causes of their vulnerability and provides insights on what classifiers are likely to be more robust against attack. Code is available at https://github.com/realcrane/BASAR-Black-box-Attack-on-Skeletal-Action-Recognition.


title: Memory-Efficient, Limb Position-Aware Hand Gesture Recognition using Hyperdimensional Computing

abstract: Electromyogram (EMG) pattern recognition can be used to classify hand gestures and movements for human-machine interface and prosthetics applications, but it often faces reliability issues resulting from limb position change. One method to address this is dual-stage classification, in which the limb position is first determined using additional sensors to select between multiple position-specific gesture classifiers. While improving performance, this also increases model complexity and memory footprint, making a dual-stage classifier difficult to implement in a wearable device with limited resources. In this paper, we present sensor fusion of accelerometer and EMG signals using a hyperdimensional computing model to emulate dual-stage classification in a memory-efficient way. We demonstrate two methods of encoding accelerometer features to act as keys for retrieval of position-specific parameters from multiple models stored in superposition. Through validation on a dataset of 13 gestures in 8 limb positions, we obtain a classification accuracy of up to 93.34%, an improvement of 17.79% over using a model trained solely on EMG. We achieve this while only marginally increasing memory footprint over a single limb position model, requiring $8\times$ less memory than a traditional dual-stage classification architecture.


title: On the forward dynamical behavior of nonautonomous lattice dynamical systems

abstract: In this article, we study the forward dynamical behavior of nonautonomous lattice systems. We first construct a family of sets $\{\mathcal{A}_\varepsilon(\sigma)\}_{\sigma\in \Sigma}$ in arbitrary small neighborhood of a global attractor of the skew-product flow generated by a general nonautonomous lattice system, which is forward invariant and uniformly forward attracts any bounded subset of the phase space. Moreover, under some suitable conditions, we further construct a family of sets $\{\mathcal{B}_\varepsilon(\sigma)\}_{\sigma\in \Sigma}$ such that it uniformly forward exponentially attracts bounded subsets of the phase space. As an application, we study the discrete Gray-Scott model in detail and illustrate how to apply our abstract results to some concrete lattice system.


title: Baryon production in the quantized fragmentation of helical QCD string

abstract: Baryon production is studied within the framework of quantized fragmentation of QCD string. Baryons appear in the model in a fairly intuitive way, with help of causally connected string breakups. A simple helical approximation of QCD flux tube with parameters constrained by mass spectrum of light mesons is sufficient to reproduce masses of light baryons.


title: PcmNet: Position-Sensitive Context Modeling Network for Temporal Action Localization

abstract: Temporal action localization is an important and challenging task that aims to locate temporal regions in real-world untrimmed videos where actions occur and recognize their classes. It is widely acknowledged that video context is a critical cue for video understanding, and exploiting the context has become an important strategy to boost localization performance. However, previous state-of-the-art methods focus more on exploring semantic context which captures the feature similarity among frames or proposals, and neglect positional context which is vital for temporal localization. In this paper, we propose a temporal-position-sensitive context modeling approach to incorporate both positional and semantic information for more precise action localization. Specifically, we first augment feature representations with directed temporal positional encoding, and then conduct attention-based information propagation, in both frame-level and proposal-level. Consequently, the generated feature representations are significantly empowered with the discriminative capability of encoding the position-aware context information, and thus benefit boundary detection and proposal evaluation. We achieve state-of-the-art performance on both two challenging datasets, THUMOS-14 and ActivityNet-1.3, demonstrating the effectiveness and generalization ability of our method.


title: Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generation

abstract: To generate "accurate" scene graphs, almost all existing methods predict pairwise relationships in a deterministic manner. However, we argue that visual relationships are often semantically ambiguous. Specifically, inspired by linguistic knowledge, we classify the ambiguity into three types: Synonymy Ambiguity, Hyponymy Ambiguity, and Multi-view Ambiguity. The ambiguity naturally leads to the issue of \emph{implicit multi-label}, motivating the need for diverse predictions. In this work, we propose a novel plug-and-play Probabilistic Uncertainty Modeling (PUM) module. It models each union region as a Gaussian distribution, whose variance measures the uncertainty of the corresponding visual content. Compared to the conventional deterministic methods, such uncertainty modeling brings stochasticity of feature representation, which naturally enables diverse predictions. As a byproduct, PUM also manages to cover more fine-grained relationships and thus alleviates the issue of bias towards frequent relationships. Extensive experiments on the large-scale Visual Genome benchmark show that combining PUM with newly proposed ResCAGCN can achieve state-of-the-art performances, especially under the mean recall metric. Furthermore, we prove the universal effectiveness of PUM by plugging it into some existing models and provide insightful analysis of its ability to generate diverse yet plausible visual relationships.


title: Rigidity of discrete conformal structures on surfaces

abstract: In \cite{G3}, Glickenstein introduced the discrete conformal structures on polyhedral surfaces in an axiomatic approach from Riemannian geometry perspective. Glickenstein's discrete conformal structures include Thurston's circle packings, Bowers-Stephenson's inversive distance circle packings and Luo's vertex scalings as special cases. Glickenstein \cite{G5} further conjectured the rigidity of the discrete conformal structures on polyhedral surfaces. Glickenstein's conjecture includes Luo's conjecture on the rigidity of vertex scalings \cite{L1} and Bowers-Stephenson's conjecture on the rigidity of inversive distance circle packings \cite{BSt} as special cases. In this paper, we prove Glickenstein's conjecture using variational principles. This unifies and generalizes the well-known results of Luo \cite{L4} and Bobenko-Pinkall-Springborn \cite{BPS}. Our method provides a unified approach to similar problems. We further discuss the relationships of Glickenstein's discrete conformal structures on polyhedral surfaces and $3$-dimensional hyperbolic geometry. As a result, we obtain some new results on the convexities of the co-volume functions of some generalized $3$-dimensional hyperbolic tetrahedra.


title: A compact and fast magnetic coil for the interaction manipulation of quantum gases with Feshbach resonances

abstract: Cold atom experiments commonly use broad magnetic Feshbach resonances to manipulate the interaction between atoms. In order to induce quantum dynamics by a change of the interaction strength, rapid ($\sim\mu s$) magnetic field changes over several tens of Gauss are required. Here we present a compact design of a coil and its control circuit for a change of the magnetic field up to $36G$ in $3\mu s$. The setup comprises two concentric solenoids with minimal space requirements, which can be readily added to existing apparatuses. This design makes the observation of non-equilibrium physics with broad Feshbach resonances accessible.


title: Explaining temporal variations in the jet position angle of the blazar OJ 287 using its binary black hole central engine model

abstract: The bright blazar OJ 287 is the best-known candidate for hosting a supermassive black hole binary system. It inspirals due to the emission of nanohertz gravitational waves (GWs). Observations of historical and predicted quasi-periodic high-brightness flares in its century-long optical lightcurve, allow us to determine the orbital parameters associated with the binary black hole (BBH) central engine. In contrast, the radio jet of OJ 287 has been covered with Very Long Baseline Interferometry (VLBI) observations for only about $30$ years and these observations reveal that the position angle (PA) of the jet exhibits temporal variations at both millimetre and centimetre wavelengths. Here we associate the observed PA variations in OJ 287 with the precession of its radio jet. In our model, the evolution of the jet direction can be associated either with the primary black hole (BH) spin evolution or with the precession of the angular momentum direction of the inner region of the accretion disc. Our Bayesian analysis shows that the BBH central engine model, primarily developed from optical observations, can also broadly explain the observed temporal variations in the radio jet of OJ 287 at frequencies of 86, 43, and 15 GHz. Ongoing Global mm-VLBI Array (GMVA) observations of OJ 287 have the potential to verify our predictions for the evolution of its $86$ GHz PA values. Additionally, thanks to the extremely high angular resolution that the Event Horizon Telescope (EHT) can provide, we explore the possibility to test our BBH model through the detection of the jet in the secondary black hole.


title: Will it Crease or Cease? A study of Debulking of Air Pockets in Automated Prepreg Composite Layup

abstract: Automatic draping of carbon-fiber prepreg plies for the aerospace industry is a promising technique for lowering the manufacturing costs and to this end, a thorough in-process quality control is crucial. In this paper, out-of-plane defects in the layup are investigated. After draping, air pockets are occasionally encountered. The question is, if such apparent defects can be mitigated sufficiently during vacuum debulking. The 3D topology is measured by means of a structured-light 3D scanner and air pockets are segmented. An approximate mass-spring ply model is used to study the behavior of the air pockets during application of vacuum pressure. The model is computationally fast and will indicate online whether the air pocket will be removed or manual intervention is required. Upon comparing the model predictions with experimental data, it is shown that the system is capable of correctly predicting 13 out of 14 air pockets in a test layup.


title: Continual Density Ratio Estimation in an Online Setting

abstract: In online applications with streaming data, awareness of how far the training or test set has shifted away from the original dataset can be crucial to the performance of the model. However, we may not have access to historical samples in the data stream. To cope with such situations, we propose a novel method, Continual Density Ratio Estimation (CDRE), for estimating density ratios between the initial and current distributions ($p/q_t$) of a data stream in an iterative fashion without the need of storing past samples, where $q_t$ is shifting away from $p$ over time $t$. We demonstrate that CDRE can be more accurate than standard DRE in terms of estimating divergences between distributions, despite not requiring samples from the original distribution. CDRE can be applied in scenarios of online learning, such as importance weighted covariate shift, tracing dataset changes for better decision making. In addition, (CDRE) enables the evaluation of generative models under the setting of continual learning. To the best of our knowledge, there is no existing method that can evaluate generative models in continual learning without storing samples from the original distribution.


title: Efficient Vertex-Oriented Polytopic Projection for Web-scale Applications

abstract: We consider applications involving a large set of instances of projecting points to polytopes. We develop an intuition guided by theoretical and empirical analysis to show that when these instances follow certain structures, a large majority of the projections lie on vertices of the polytopes. To do these projections efficiently we derive a vertex-oriented incremental algorithm to project a point onto any arbitrary polytope, as well as give specific algorithms to cater to simplex projection and polytopes where the unit box is cut by planes. Such settings are especially useful in web-scale applications such as optimal matching or allocation problems. Several such problems in internet marketplaces (e-commerce, ride-sharing, food delivery, professional services, advertising, etc.), can be formulated as Linear Programs (LP) with such polytope constraints that require a projection step in the overall optimization process. We show that in the very recent work, the polytopic projection is the most expensive step and our efficient projection algorithms help in gaining massive improvements in performance.


title: Experimental observation of the avoided crossing of two $S$-matrix resonance poles in an ultracold atom collider

abstract: In quantum mechanics, collisions between two particles are captured by a scattering matrix which describes the transfer from an initial entrance state to an outgoing final state. Analyticity of the elements of this $S$-matrix enables their continuation onto the complex energy plane and opens up a powerful and widely used framework in scattering theory, where bound states and scattering resonances for a physical system are ascribed to $S$-matrix poles. In the Gedankenexperiment of gradually changing the potential parameters of the system, the complex energy poles will begin to move, and in their ensuing flow, two poles approaching will interact. An actual observation of this intriguing interaction between scattering poles in a collision experiment has, however, been elusive. Here, we expose the interplay between two scattering poles relating to a shape resonance and a magnetically tunable Feshbach resonance by studying ultracold atoms with a laser-based collider. We exploit the tunability of the Feshbach resonance to observe a compelling avoided crossing of the poles in their energies which is the hallmark of a strongly coupled system.


title: A Stochastic Theory of the Hierarchical Clustering II. Halo progenitor mass function and large-scale bias

abstract: We generalize the stochastic theory of hierarchical clustering presented in paper I by Lapi & Danese (2020) to derive the (conditional) halo progenitor mass function and the related large-scale bias. Specifically, we present a stochastic differential equation that describes fluctuations in the mass growth of progenitor halos of given descendant mass and redshift, as driven by a multiplicative Gaussian white noise involving the power spectrum and the spherical collapse threshold of density perturbations. We demonstrate that, as cosmic time passes, the noise yields an average drift of the progenitors toward larger masses, that quantitatively renders the expectation from the standard extended Press & Schechter (EPS) theory. We solve the Fokker-Planck equation associated to the stochastic dynamics, and obtain as an exact, stationary solution the EPS progenitor mass function. Then we introduce a modification of the stochastic equation in terms of a mass-dependent collapse threshold modulating the noise, and solve analytically the associated Fokker-Planck equation for the progenitor mass function. The latter is found to be in excellent agreement with the outcomes of $N-$body simulations; even more remarkably, this is achieved with the same shape of the collapse threshold used in paper I to reproduce the halo mass function. Finally, we exploit the above results to compute the large-scale halo bias, and find it in pleasing agreement with the $N-$body outcomes. All in all, the present paper illustrates that the stochastic theory of hierarchical clustering introduced in paper I can describe effectively not only halos' abundance, but also their progenitor distribution and their correlation with the large-scale environment across cosmic times.


title: A Brief Historical Perspective on the Consistent Histories Interpretation of Quantum Mechanics

abstract: It will be presented in this chapter a historical account of the consistent histories interpretation of quantum mechanics based on primary and secondary literature. Firstly, the formalism of the consistent histories approach will be outlined. Secondly, the works by Robert Griffiths and Roland Omn\`es will be discussed. Griffiths' seminal 1984 paper, the first physicist to have proposed a consistent-histories interpretation of quantum mechanics, followed by Omn\`es' 1990 paper, were instrumental to the consistent-histories model based on Boolean logic. Thirdly, Murray Gell-Mann and James Hartle's steps to their own version of consistent-histories approach, motivated by a cosmological perspective, will then be described and evaluated. Gell-Mann and Hartle understood that spontaneous decoherence could path the way to a concrete physical model to Griffiths' consistent histories. Moreover, the collective biography of these figures will be put in the context of the role played by the Santa Fe Institute, co-founded by Gell-Mann in 1984 in Santa Fe, New Mexico, where Hartle is also a member of the external faculty.


title: Density of rational points near/on compact manifolds with certain curvature conditions

abstract: In this article we establish an asymptotic formula for the number of rational points, with bounded denominators, within a given distance to a compact submanifold $\mathcal{M}$ of $\mathbb{R}^M$ with a certain curvature condition. Our result generalises earlier work of Huang for hypersurfaces [J.-J. Huang, The density of rational points near hypersurfaces, Duke Math. J. 169 (2020), 2045--2077.], as our curvature condition reduces to Gaussian curvature being bounded away from $0$ when $M - dim \mathcal{M} = 1$. An interesting feature of our result is that the asymptotic formula holds beyond the conjectured range of the distance to $\mathcal{M}$. Furthermore, we obtain an upper bound for the number of rational points on $\mathcal{M}$ with additional power saving to the bound in the analogue of Serre's dimension growth conjecture for compact submanifolds of $\mathbb{R}^M$ when $M - dim \mathcal{M} > 1$.


title: Threshold effects as the origin of $Z_{cs}(4000)$, $Z_{cs}(4220)$ and $X(4700)$ observed in $B^+\to J/\psi \phi K^+$

abstract: We investigate the $B^+\to J/\psi \phi K^+$ decay via various rescattering diagrams. Without introducing genuine exotic resonances, it is shown that the $Z_{cs}(4000)$, $Z_{cs}(4220)$ and $X(4700)$ reported by the LHCb collaboration can be simulated by the $J/\psi K^{*+}$, $\psi^\prime K^+$ and $\psi^\prime \phi$ threshold cusps, respectively. These cusps are enhanced by some nearby triangle singularities. The $X(4685)$ with $J^P=1^+$ cannot be well simulated by the threshold effects in our model, which implies that it may be a genuine resonance.


title: Conservative and accurate solution transfer between high-order and low-order refined finite element spaces

abstract: In this paper we introduce general transfer operators between high-order and low-order refined finite element spaces that can be used to couple high-order and low-order simulations. Under natural restrictions on the low-order refined space we prove that both the high-to-low-order and low-to-high-order linear mappings are conservative, constant preserving and high-order accurate. While the proofs apply to affine geometries, numerical experiments indicate that the results hold for more general curved and mixed meshes. These operators also have applications in the context of coarsening solution fields defined on meshes with nonconforming refinement. The transfer operators for $H^1$ finite element spaces require a globally coupled solve, for which robust and efficient preconditioners are developed. We present several numerical results confirming our analysis and demonstrate the utility of the new mappings in the context of adaptive mesh refinement and conservative multi-discretization coupling.


title: Open-book Video Captioning with Retrieve-Copy-Generate Network

abstract: Due to the rapid emergence of short videos and the requirement for content understanding and creation, the video captioning task has received increasing attention in recent years. In this paper, we convert traditional video captioning task into a new paradigm, \ie, Open-book Video Captioning, which generates natural language under the prompts of video-content-relevant sentences, not limited to the video itself. To address the open-book video captioning problem, we propose a novel Retrieve-Copy-Generate network, where a pluggable video-to-text retriever is constructed to retrieve sentences as hints from the training corpus effectively, and a copy-mechanism generator is introduced to extract expressions from multi-retrieved sentences dynamically. The two modules can be trained end-to-end or separately, which is flexible and extensible. Our framework coordinates the conventional retrieval-based methods with orthodox encoder-decoder methods, which can not only draw on the diverse expressions in the retrieved sentences but also generate natural and accurate content of the video. Extensive experiments on several benchmark datasets show that our proposed approach surpasses the state-of-the-art performance, indicating the effectiveness and promising of the proposed paradigm in the task of video captioning.


title: 3D-QCNet -- A Pipeline for Automated Artifact Detection in Diffusion MRI images

abstract: Artifacts are a common occurrence in Diffusion MRI (dMRI) scans. Identifying and removing them is essential to ensure the accuracy and viability of any post processing carried out on these scans. This makes QC (quality control) a crucial first step prior to any analysis of dMRI data. Several QC methods for artifact detection exist, however they suffer from problems like requiring manual intervention and the inability to generalize across different artifacts and datasets. In this paper, we propose an automated deep learning (DL) pipeline that utilizes a 3D-Densenet architecture to train a model on diffusion volumes for automatic artifact detection. Our method is applied on a vast dataset consisting of 9000 volumes sourced from 7 large clinical datasets. These datasets comprise scans from multiple scanners with different gradient directions, high and low b values, single shell and multi shell acquisitions. Additionally, they represent diverse subject demographics like the presence or absence of pathologies. Our QC method is found to accurately generalize across this heterogenous data by correctly detecting 92% artifacts on average across our test set. This consistent performance over diverse datasets underlines the generalizability of our method, which currently is a significant barrier hindering the widespread adoption of automated QC techniques. For these reasons, we believe that 3D-QCNet can be integrated in diffusion pipelines to effectively automate the arduous and time-intensive process of artifact detection.


title: The fate of the Kondo cloud in a superconductor

abstract: Magnetic impurities embedded in a metal are screened by the Kondo effect, signaled by the formation of an extended correlation cloud, the so-called Kondo or screening cloud. In a superconductor, the Kondo state turns into sub-gap Yu-Shiba-Rusinov (Shiba) states, and a quantum phase transition occurs between screened and unscreened phases once the superconducting energy gap $\Delta$ becomes sufficiently large compared to the Kondo temperature, $T_K$. Here we show that, although the Kondo state does not form in the unscreened phase, the Kondo cloud does exist in both quantum phases. However, while screening is complete in the screened phase, it is only partial in the unscreened phase. Compensation, a quantity introduced to characterize the integrity of the cloud, is universal, and shown to be related to the magnetic impurities' $g$-factor, monitored experimentally by bias spectroscopy.


title: Inverse problem for determining the order of fractional derivative in mixed-type equations

abstract: In this paper the inverse problem of determining the fractional orders in mixed-type equations is considered. In one part of the domain the considered equation is the subdiffusion equation with a fractional derivative in the sense of Gerasimov-Caputo of the order 0<a<1 , and in the other part - a wave equation with a fractional derivative of the order 1<b<2 . The elliptic part of the equation is a second-order operator, considered in a N - dimensional domain D. Assuming the parameters a and b to be unknown, additional conditions are found that provide an unambiguous determination of the required parameters.


title: DISC: A Dynamic Shape Compiler for Machine Learning Workloads

abstract: Many recent machine learning models show dynamic shape characteristics. However, existing AI compiler optimization systems suffer a lot from problems brought by dynamic shape models, including compilation overhead, memory usage, optimization pipeline and deployment complexity. This paper provides a compiler system to natively support optimization for dynamic shape workloads, named DISC. DISC enriches a set of IR to form a fully dynamic shape representation. It generates the runtime flow at compile time to support processing dynamic shape based logic, which avoids the interpretation overhead at runtime and enlarges the opportunity of host-device co-optimization. It addresses the kernel fusion problem of dynamic shapes with shape propagation and constraints collecting methods. This is the first work to demonstrate how to build an end-to-end dynamic shape compiler based on MLIR infrastructure. Experiments show that DISC achieves up to 3.3x speedup than TensorFlow/PyTorch, and 1.8x than Nimble.


title: The Response of Optical Fibres to Gravitational Waves

abstract: The response of optical fibre modes to plane gravitational waves of low frequency is computed. By solving perturbatively the Maxwell equations for step-index optical fibres in a gravitational wave background and implementing appropriate boundary conditions to describe single-mode fibres, explicit formulae for the perturbations of the phase and the polarisation of the fibre modes are obtained.


title: A prior-based approximate latent Riemannian metric

abstract: Stochastic generative models enable us to capture the geometric structure of a data manifold lying in a high dimensional space through a Riemannian metric in the latent space. However, its practical use is rather limited mainly due to inevitable complexity. In this work we propose a surrogate conformal Riemannian metric in the latent space of a generative model that is simple, efficient and robust. This metric is based on a learnable prior that we propose to learn using a basic energy-based model. We theoretically analyze the behavior of the proposed metric and show that it is sensible to use in practice. We demonstrate experimentally the efficiency and robustness, as well as the behavior of the new approximate metric. Also, we show the applicability of the proposed methodology for data analysis in the life sciences.


title: Medium-spin states of the neutron-rich nucleus $^{87}$Br

abstract: Medium-spin excited states of the neutron-rich nucleus $^{87}$Br were observed and studied for the first time. They were populated in fission of $^{235}$U induced by the cold-neutron beam of the PF1B facility of the Institut Laue-Langevin, Grenoble. The measurement of $\gamma$ radiation following fission has been performed using the EXILL array of Ge detectors. The observed level scheme was compared with results of large valence space shell model calculations. The medium-spin level scheme consists of three band-like structures, which can be understood as bands built on the ${\pi}f_{5/2}$, ${\pi}(p_{3/2}+f_{5/2})$ and ${\pi}g_{9/2}$ configurations. The behavior of the observed ${\pi}g_{9/2}$ band at high spins shows a considerable deviation from the shell model predictions. This deviation in this band is probably the result of an increased collectivity, which can be understood assuming that the ${\pi}g_{9/2}$ high-$\it j$ proton polarizes the core.


title: Deep Learning for Android Malware Defenses: a Systematic Literature Review

abstract: Malicious applications (particularly those targeting the Android platform) pose a serious threat to developers and end-users. Numerous research efforts have been devoted to developing effective approaches to defend against Android malware. However, given the explosive growth of Android malware and the continuous advancement of malicious evasion technologies like obfuscation and reflection, Android malware defense approaches based on manual rules or traditional machine learning may not be effective. In recent years, a dominant research field called deep learning (DL), which provides a powerful feature abstraction ability, has demonstrated a compelling and promising performance in a variety of areas, like natural language processing and computer vision. To this end, employing deep learning techniques to thwart Android malware attacks has recently garnered considerable research attention. Yet, no systematic literature review focusing on deep learning approaches for Android Malware defenses exists. In this paper, we conducted a systematic literature review to search and analyze how deep learning approaches have been applied in the context of malware defenses in the Android environment. As a result, a total of 132 studies covering the period 2014-2021 were identified. Our investigation reveals that, while the majority of these sources mainly consider DL-based on Android malware detection, 53 primary studies (40.1 percent) design defense approaches based on other scenarios. This review also discusses research trends, research focuses, challenges, and future research directions in DL-based Android malware defenses.


title: Decentralized Circle Formation Control for Fish-like Robots in the Real-world via Reinforcement Learning

abstract: In this paper, the circle formation control problem is addressed for a group of cooperative underactuated fish-like robots involving unknown nonlinear dynamics and disturbances. Based on the reinforcement learning and cognitive consistency theory, we propose a decentralized controller without the knowledge of the dynamics of the fish-like robots. The proposed controller can be transferred from simulation to reality. It is only trained in our established simulation environment, and the trained controller can be deployed to real robots without any manual tuning. Simulation results confirm that the proposed model-free robust formation control method is scalable with respect to the group size of the robots and outperforms other representative RL algorithms. Several experiments in the real world verify the effectiveness of our RL-based approach for circle formation control.


title: Counting spanning trees in a complete bipartite graph which contain a given spanning forest

abstract: In this article, we extend Moon's classic formula for counting spanning trees in complete graphs containing a fixed spanning forest to complete bipartite graphs. Let $(X,Y)$ be the bipartition of the complete bipartite graph $K_{m,n}$ with $|X|=m$ and $|Y|=n$. We prove that for any given spanning forest $F$ of $K_{m,n}$ with components $T_1,T_2,\ldots,T_k$, the number of spanning trees in $K_{m,n}$ which contain all edges in $F$ is equal to $$ \frac 1{mn}\left(\prod_{i=1}^k (m_in+n_im)\right) \left (1-\sum_{i=1}^{k}\frac{m_in_i}{m_in+n_im}\right ), $$ where $m_i=|V(T_i)\cap X|$ and $n_i=|V(T_i)\cap Y|$ for $i=1,2,\ldots,k$.


title: Lepton flavor violation and leptogenesis in discrete flavor symmetric scotogenic model

abstract: We have studied the scotogenic model proposed by Ernest Ma, which is an extension of the Standard Model by three singlet right-handed neutrinos and a scalar doublet. This model proposes that the light neutrinos acquire a non-zero mass at 1-loop level. In this work, the realisation of the scotogenic model is done by using discrete symmetries $A_{4}\times Z_{4}$ in which the non-zero $\theta_{13}$ is produced by assuming a non-degeneracy in the loop factor. Considering different lepton flavor violating(LFV) processes such as $l_{\alpha}\longrightarrow l_{\beta}\gamma$ and $l_{\alpha}\longrightarrow 3l_{\beta}$, their impact on neutrino phenomenology is studied. We have also analysed $0\nu\beta\beta$ and baryon asymmetry of the Universe (BAU) in this work.


title: Attention-driven read-aloud technology increases reading comprehension in children with reading disabilities

abstract: The paper presents the design of an assistive reading tool that integrates read-aloud technology with eye-tracking to regulate the speed of reading and support struggling readers in following the text while listening to it. The paper describes the design rationale of this approach, following the theory of auditory-visual integration, in terms of an automatic self-adaptable technique based on the reader's gaze that provides an individualized interaction experience. This tool has been assessed in a controlled experiment with 20 children (aged 8-10 years) with a diagnosis of dyslexia and a control group of 20 children with typical reading abilities. The results show that children with reading difficulties improved their comprehension scores by 24% measured on a standardized instrument for the assessment of reading comprehension, and that children with more inaccurate reading (N=9) tended to benefit more. The findings are discussed in terms of a better integration between audio and visual text information, paving the way to improve standard read-aloud technology with gaze-contingency and self-adaptable techniques to personalize the reading experience.


title: Pauli spin blockade with site-dependent g-tensors and spin-polarized leads

abstract: Pauli spin blockade (PSB) in double quantum dots (DQDs) has matured into a prime technique for precise measurements of nanoscale system parameters. In this work we demonstrate that systems with site-dependent g-tensors and spin-polarized leads allow for a complete characterization of the g-tensors in the dots by magnetotransport experiments alone. Additionally, we show that special polarization configurations can enhance the often elusive magnetotransport signal, rendering the proposed technique robust against noise in the system, and inducing a giant magnetoresistance effect. Finally, we incorporate the effects of the spin-orbit interaction (SOI) and show that in this case the leakage current contains information about the degree of spin polarization in the leads.


title: Cosilting modules arising from cotilting objects

abstract: Let $R$ be a ring. In this paper, we study the characterization of cosilting modules and establish a relation between cosilting modules and cotilting objects in a Grothendieck category. We proved that each cosilting right $R$-module $T$ can be described as a cotilting object in $\sigma[R/I]$, where $I$ is a right ideal of $R$ determined by $T$ and $\sigma[R/I]$ is the full subcategory of right $R$-modules, consisting of submodules of $R/I$-generated modules. Conversely, under some suitable conditions, if $T$ is a cotilting object in $\sigma[R/I]$, then $T$ is cosilting.


title: Maximum Likelihood Estimation for Hawkes Processes with self-excitation or inhibition

abstract: In this paper, we present a maximum likelihood method for estimating the parameters of a univariate Hawkes process with self-excitation or inhibition. Our work generalizes techniques and results that were restricted to the self-exciting scenario. The proposed estimator is implemented for the classical exponential kernel and we show that, in the inhibition context, our procedure provides more accurate estimations than current alternative approaches.


title: Initial value problem for one-dimensional rotating shallow water equations

abstract: In this article we address some issues related to the initial value problems for a rotating shallow water hyperbolic system of equations and the diffusive regularization of this system. For initial data close to the solution at rest, we establish the local existence and the uniqueness of a solution to the hyperbolic system, as well as the global existence of a solution to the regularized system. In order to prove this, we use suitable variables that symmetrize the system.


title: Measuring distance between quantum states on a quantum computer

abstract: We propose protocols for determining the distances in Hilbert space between pure and mixed quantum states prepared on a quantum computer. In the case of pure quantum states, the protocol is based on measuring the square of modulus of scalar product between certain states. Determination of the distance between mixed quantum states is reduced to measuring the squares of modules of scalar products between all pure states included in the mixed states. In addition, we develop a protocol that allows one to determine the speed of evolution of the spin system simulated by a quantum computer. These protocols we apply to measure distances and speeds of evolution of different quantum systems implemented on the ibmq-santiago quantum computer.


title: Semantics-Consistent Representation Learning for Remote Sensing Image-Voice Retrieval

abstract: With the development of earth observation technology, massive amounts of remote sensing (RS) images are acquired. To find useful information from these images, cross-modal RS image-voice retrieval provides a new insight. This paper aims to study the task of RS image-voice retrieval so as to search effective information from massive amounts of RS data. Existing methods for RS image-voice retrieval rely primarily on the pairwise relationship to narrow the heterogeneous semantic gap between images and voices. However, apart from the pairwise relationship included in the datasets, the intra-modality and non-paired inter-modality relationships should also be taken into account simultaneously, since the semantic consistency among non-paired representations plays an important role in the RS image-voice retrieval task. Inspired by this, a semantics-consistent representation learning (SCRL) method is proposed for RS image-voice retrieval. The main novelty is that the proposed method takes the pairwise, intra-modality, and non-paired inter-modality relationships into account simultaneously, thereby improving the semantic consistency of the learned representations for the RS image-voice retrieval. The proposed SCRL method consists of two main steps: 1) semantics encoding and 2) semantics-consistent representation learning. Firstly, an image encoding network is adopted to extract high-level image features with a transfer learning strategy, and a voice encoding network with dilated convolution is devised to obtain high-level voice features. Secondly, a consistent representation space is conducted by modeling the three kinds of relationships to narrow the heterogeneous semantic gap and learn semantics-consistent representations across two modalities. Extensive experimental results on three challenging RS image-voice datasets show the effectiveness of the proposed method.


title: Entanglement entropy in scalar field theory and $\mathbb{Z}_M$ gauge theory on Feynman diagrams

abstract: Entanglement entropy (EE) in interacting field theories has two important issues: renormalization of UV divergences and non-Gaussianity of the vacuum. In this letter, we investigate them in the framework of the two-particle irreducible formalism. In particular, we consider EE of a half space in an interacting scalar field theory. It is formulated as $\mathbb{Z}_M$ gauge theory on Feynman diagrams: $\mathbb{Z}_M$ fluxes are assigned on plaquettes and summed to obtain EE. Some configurations of fluxes are interpreted as twists of propagators and vertices. The former gives a Gaussian part of EE written in terms of a renormalized 2-point function while the latter reflects non-Gaussianity of the vacuum.


title: Modelling and testing the equation of state for (Early) dark energy

abstract: A general equation of state is considered for analysing the possible behaviors for (Early) dark energy that alleviates the Hubble parameter tension problem. By departing from the possible evolution for the (Early) dark energy density and the corresponding dynamical equations, the equation of state is obtained, which allow us to analyze qualitatively the cosmological evolution and the dominance of each term in the equation of state along the cosmic expansion, which show some interesting consequences as the occurrence of (past) future singularities. Then, by considering two general models, their free parameters are fit with different sources of data, showing the goodness of the fits in comparison to more standard models. Results might be considered as a promising starting point to get a better understanding of the cosmological evolution as a whole.


title: An invariant characterization of the quasi-spherical Szekeres dust models

abstract: The quasi-spherical Szekeres dust solutions are a generalization of the spherically symmetric Lemaitre-Tolman-Bondi dust models where the spherical shells of constant mass are non-concentric. The quasi-spherical Szekeres dust solutions can be considered as cosmological models and are potentially models for the formation of primordial black holes in the early universe. Any collapsing quasi-spherical Szekeres dust solution where an apparent horizon covers all shell-crossings that will occur can be considered as a model for the formation of a black hole. In this paper we will show that the apparent horizon can be detected by a Cartan invariant. We will show that particular Cartan invariants characterize properties of these solutions which have a physical interpretation such as: the expansion or contraction of spacetime itself, the relative movement of matter shells, shell-crossings and the appearance of necks and bellies.


title: A problem on concatenated integers

abstract: Motivated by a WhattsApp message, we find out the integers $x> y\ge 1$ such that $(x+1)/(y+1)=(x\circ(y+1))/(y\circ (x+1))$, where $\circ$ means the concatenation of the strings of two natural numbers (for instance $783\circ 56=78356$). The discussion involves the equation $x(x+1)=10y(y+1)$, a slight variation of Pell's equation related to the arithmetic of the Dedekind ring $\mathbb{Z}[\sqrt{10}]$. We obtain the infinite sequence $\mathcal{S}=\{(x_n,y_n)\}_{n\ge 1}$ of all the solutions of the equation $x(x+1)=10y(y+1)$, which tourn out to have limit $1/\sqrt{10}$. The solutions of the initial problem on concatenated integers form the infinite subsequence of $\mathcal{S}$ formed by the pairs $(x_n,y_n)$ such that $x_n$ has one more digit that $y_n$.


title: Schr\"{o}dinger-cat states in Landau-Zener-St\"{u}ckelberg-Majorana interferometry: a multiple Davydov Ansatz approach

abstract: Employing the time-dependent variational principle combined with the multiple Davydov $\mathrm{D}_2$ Ansatz, we investigate Landau-Zener (LZ) transitions in a qubit coupled to a photon mode with various initial photon states at zero temperature. Thanks to the multiple Davydov trial states, exact photonic dynamics taking place in the course of the LZ transition is also studied efficiently. With the qubit driven by a linear external field and the photon mode initialized with Schr\"odinger-cat states, asymptotic behavior of the transition probability beyond the rotating-wave approximation is uncovered for a variety of initial states. Using a sinusoidal external driving field, we also explore the photon-assisted dynamics of Landau-Zener-St\"{u}ckelberg-Majorana interferometry. Transition pathways involving multiple energy levels are unveiled by analyzing the photon dynamics.


title: Possibility of the total thermodynamic entropy production rate of a finite-sized isolated quantum system to be negative for the Gorini-Kossakowski-Sudarshan-Lindblad-type Markovian dynamics of its subsystem

abstract: We investigate a total thermodynamic entropy production rate of an isolated quantum system. In particular, we consider a quantum model of coupled harmonic oscillators in a star configuration, where a central harmonic oscillator (system) is coupled to a finite number of surrounding harmonic oscillators (bath). In this model, when the initial state of the total system is given by the tensor product of the Gibbs states of the system and the bath, every harmonic oscillator is always in a Gibbs state with a time-dependent temperature. This enables us to define time-dependent thermodynamic entropy for each harmonic oscillator and total nonequilibrium thermodynamic entropy as the summation of them. We analytically confirm that the total thermodynamic entropy satisfies the third law of thermodynamics. Our numerical solutions show that, even when the dynamics of the system is well approximated by the Gorini-Kossakowski-Sudarshan-Lindblad (GKSL)-type Markovian master equation, the total thermodynamic entropy production rate can be negative, while the total thermodynamic entropy satisfies the second law of thermodynamics. This result is a counterexample to the common belief that the total entropy production rate is non-negative when the system is under the GKSL-type Markovian dynamics.


title: Trade-offs in the Design of Multimodal Interaction for Older Adults

abstract: This paper presents key aspects and trade-offs that designers and Human-Computer Interaction practitioners might encounter when designing multimodal interaction for older adults. The paper gathers literature on multimodal interaction and assistive technology, and describes a set of design challenges specific for older users. Building on these main design challenges, four trade-offs in the design of multimodal technology for this target group are presented and discussed. To highlight the relevance of the trade-offs in the design process of multimodal technology for older adults, two of the four reported trade-offs are illustrated with two user studies that explored mid-air and speech-based interaction with a tablet device. The first study investigates the design trade-offs related to redundant multimodal commands in older, middle-aged and younger adults, whereas the second one investigates the design choices related to the definition of a set of mid-air one-hand gestures and voice input commands. Further reflections highlight the design trade-offs that such considerations bring in the process, presenting an overview of the design choices involved and of their potential consequences.


title: Bio-Inspired Representation Learning for Visual Attention Prediction

abstract: Visual Attention Prediction (VAP) is a significant and imperative issue in the field of computer vision. Most of existing VAP methods are based on deep learning. However, they do not fully take advantage of the low-level contrast features while generating the visual attention map. In this paper, a novel VAP method is proposed to generate visual attention map via bio-inspired representation learning. The bio-inspired representation learning combines both low-level contrast and high-level semantic features simultaneously, which are developed by the fact that human eye is sensitive to the patches with high contrast and objects with high semantics. The proposed method is composed of three main steps: 1) feature extraction, 2) bio-inspired representation learning and 3) visual attention map generation. Firstly, the high-level semantic feature is extracted from the refined VGG16, while the low-level contrast feature is extracted by the proposed contrast feature extraction block in a deep network. Secondly, during bio-inspired representation learning, both the extracted low-level contrast and high-level semantic features are combined by the designed densely connected block, which is proposed to concatenate various features scale by scale. Finally, the weighted-fusion layer is exploited to generate the ultimate visual attention map based on the obtained representations after bio-inspired representation learning. Extensive experiments are performed to demonstrate the effectiveness of the proposed method.


title: Energy-Efficient MAC for Cellular IoT: State-of-the-Art, Challenges, and Standardization

abstract: In the modern world, the connectivity-as-we-go model is gaining popularity. Internet-of-Things (IoT) envisions a future in which human beings communicate with each other and with devices that have identities and virtual personalities, as well as sensing, processing, and networking capabilities, which will allow the developing of smart environments that operate with little or no human intervention. In such IoT environments, that will have battery-operated sensors and devices, energy efficiency becomes a fundamental concern. Thus, energy-efficient (EE) connectivity is gaining significant attention from the industrial and academic communities. This work aims to provide a comprehensive state-of-the-art survey on the energy efficiency of medium access control (MAC) protocols for cellular IoT. we provide a detailed discussion on the sources of energy dissipation at the MAC layer and then propose solutions. In addition to reviewing the proposed MAC designs, we also provide insights and suggestions that can guide practitioners and researchers in designing EE MAC protocols that extend the battery life of IoT devices. Finally, we identify a range of challenging open problems that should be solved for providing EE MAC services for IoT devices, along with corresponding opportunities and future research ideas to address these challenges.


title: Chemical physics of superconductivity in layered yttrium carbide halides from first principles

abstract: We perform a thorough first-principles study on superconductivity in yttrium carbide halide Y$_2$$X_2$C$_2$ ($X$=Cl, Br, I) whose maximum transition temperature ($T_{\rm c}$) amounts to $\sim$10 K. A detailed analysis on the optimized crystal structures reveals that the Y$_2$C$_2$ blocks are compressed uniaxially upon the halogen substitution from Cl, Br to I, contrary to the monotonic expansion of the lattice vectors. With a nonempirical method based on the density functional theory for superconductors within the conventional phonon mechanism, we successfully reproduce the halogen dependence of $T_{\rm c}$. Anomalously enhanced coupling of one C$_2$ libration mode is observed in Y$_2$I$_2$C$_2$, which imply possible departure from the conventional pairing picture. Utilizing the Wannier representation of the electron-phonon coupling, we show that the halogen electronic orbitals and ionic vibrations scarcely contribute to the superconducting pairing. The halogen dependence of this system is hence an indirect effect of the halogen ions through the uniaxial compressive force on the superconducting Y$_2$C$_2$ blocks. We thus establish a quantitatively reliable picture of the superconducting physics of this system, extracting a unique effect of the atomic substitution which is potentially applicable to other superconductors.


title: Spacetime might not be doomed after all

abstract: Popular wisdom amongst theoretical physicists says that the continuum structure of spacetime is probably not elementary, but rather emergent. While many arguments to support that view arise from speculative ideas, the argument can also be made by only invoking standard physics. In this manuscript, I shall argue that a novel general theory of relativity might change the deal, while it corresponds to a somewhat minimal extension of the core theory of physics.


title: "Striped" Rectangular Rigid Box with Hermitian and non-Hermitian $\mathcal{PT}$ Symmetric Potentials

abstract: Eigenspectra of a spinless quantum particle trapped inside a rigid, rectangular, two-dimensional (2D) box subject to diverse inner potential distributions are investigated under hermitian, as well as non-hermitian antiunitary $\mathcal{PT}$ (composite parity and time-reversal) symmetric regimes. Four sectors or "stripes" inscribed in the rigid box comprising contiguously conjoined parallel rectangular segments with one side equaling the entire width of the box are studied. The stripes encompass piecewise constant potentials whose exact, complete energy eigenspectrum is obtained employing matrix mechanics. Various striped potential compositions, viz. real valued ones in the hermitian regime as well as complex, non-hermitian but $\mathcal{PT}$ symmetric ones are considered separately and in conjunction, unraveling among typical lowest lying eigenvalues, retention and breakdown scenarios engendered by the $\mathcal{PT}$ symmetry, bearing upon the strength of non-hermitian sectors. Some states exhibit a remarkable crossover of symmetry `making' and `breaking': while a broken $\mathcal{PT}$ gets reinstated for an energy level, higher levels may couple to continue with symmetry breaking. Further, for a charged quantum particle a $\mathcal{PT}$ symmetric electric field, furnished with a striped potential backdrop, also reveals peculiar retention and breakdown $\mathcal{PT}$ scenarios. Depictions of prominent probability redistributions relating to various potential distributions both under norm-conserving unitary regime for hermitian Hamiltonians and non-conserving ones post $\mathcal{PT}$ breakdown are presented.


title: Beam delivery systems for linac-based proton therapy

abstract: This report presents a design of a gantry for proton therapy based on the concept of adiabatic transition. The use of fixed-field alternating gradient magnets allows a large momentum acceptance and supports fast energy modulation. The optical performance of the gantry has been analysed using a beam tracking code. Several optimisations of the lattice and transition sections have been investigated to reduce size and ensure applicability to pencil beam scanning. Matching of the full energy range results in an increase in the size of the gantry, but reduces the weight and cost significantly compared to those that pertain to facilities in operation.


title: Multi-range percolation on oriented trees: critical curve and limit behavior

abstract: We consider an inhomogeneous oriented percolation model introduced by de Lima, Rolla and Valesin. In this model, the underlying graph is an oriented rooted tree in which each vertex points to each of its $d$ children with `short' edges, and in addition, each vertex points to each of its $d^k$ descendant at a fixed distance $k$ with `long' edges. A bond percolation process is then considered on this graph, with the prescription that independently, short edges are open with probability $p$ and long edges are open with probability $q$. We study the behavior of the critical curve $q_c(p)$: we find the first two terms in the expansion of $q_c(p)$ as $k \to \infty$, and prove that the critical curve lies strictly above the critical curve of a related branching process, in the relevant parameter region. We also prove limit theorems for the percolation cluster in the supercritical, subcritical and critical regimes.


title: Competition in Costly Talk

abstract: This paper studies a communication game between an uninformed decision maker and two perfectly informed senders with conflicting interests. Senders can misreport information at a cost that increases with the size of the misrepresentation. The main results show that equilibria where the decision maker obtains the complete-information payoff hinge on beliefs with undesirable properties. The imposition of a minimal and sensible belief structure is sufficient to generate a robust and essentially unique equilibrium with partial information transmission. A complete characterization of this equilibrium unveils the language senders use to communicate.


title: Stability of some two dimensional wave maps: a wave--Klein-Gordon model

abstract: We are interested in the stability of a class of totally geodesic wave maps, as recently studied by Abbrescia and Chen, and later by Duan and Ma. The relevant equations of motion are a system of coupled semilinear wave and Klein-Gordon equations in $\mathbb{R}^{1+n}$ whose nonlinearities are critical when $n=2$. In this paper we use a pure energy method to show global existence when $n=2$. By carefully examining the structure of the nonlinear terms, we are able to obtain uniform energy bounds at lower orders. This allows us to prove pointwise decay estimates and also to reduce the required regularity.


title: Machine Learning based Efficient QT-MTT Partitioning Scheme for VVC Intra Encoders

abstract: The next-generation Versatile Video Coding (VVC) standard introduces a new Multi-Type Tree (MTT) block partitioning structure that supports Binary-Tree (BT) and Ternary-Tree (TT) splits in both vertical and horizontal directions. This new approach leads to five possible splits at each block depth and thereby improves the coding efficiency of VVC over that of the preceding High Efficiency Video Coding (HEVC) standard, which only supports Quad-Tree (QT) partitioning with a single split per block depth. However, MTT also has brought a considerable impact on encoder computational complexity. In this paper, a two-stage learning-based technique is proposed to tackle the complexity overhead of MTT in VVC intra encoders. In our scheme, the input block is first processed by a Convolutional Neural Network (CNN) to predict its spatial features through a vector of probabilities describing the partition at each 4x4 edge. Subsequently, a Decision Tree (DT) model leverages this vector of spatial features to predict the most likely splits at each block. Finally, based on this prediction, only the N most likely splits are processed by the Rate-Distortion (RD) process of the encoder. In order to train our CNN and DT models on a wide range of image contents, we also propose a public VVC frame partitioning dataset based on existing image dataset encoded with the VVC reference software encoder. Our proposal relying on the top-3 configuration reaches 46.6% complexity reduction for a negligible bitrate increase of 0.86%. A top-2 configuration enables a higher complexity reduction of 69.8% for 2.57% bitrate loss. These results emphasis a better trade-off between VTM intra coding efficiency and complexity reduction compared to the state-of-the-art solutions.


title: Combining information from multiple cosmological surveys: inference and modeling challenges

abstract: The tightest and most robust cosmological results of the next decade will be achieved by bringing together multiple surveys of the Universe. This endeavor has to happen across multiple layers of the data processing and analysis, e.g., enhancements are expected from combining Euclid, Rubin, and Roman (as well as other surveys) not only at the level of joint processing and catalog combination, but also during the post-catalog parts of the analysis such as the cosmological inference process. While every experiment builds their own analysis and inference framework and creates their own set of simulations, cross-survey work that homogenizes these efforts, exchanges information from numerical simulations, and coordinates details in the modeling of astrophysical and observational systematics of the corresponding datasets is crucial.


title: User Association in Scalable Cell-Free Massive MIMO Systems

abstract: In this work, we consider the uplink of a scalable cell-free massive MIMO system where the users are served only by a subset of access points (APs) in the network. The APs are physically grouped into predetermined "cell-centric clusters", which are connected to different cooperative central processing units (CPUs). Given the cooperative nature of the considered communications network, we assume that each user is associated with a "virtual cluster", that, in general, involves some APs belonging to different cell-centric clusters. Assuming the maximum-ratio-combining at the APs, we propose a user-association procedure aimed at the maximization of the sum-rate of the users in the system. The proposed procedure is based on the Hungarian Algorithm and exploits only the knowledge of the position of the APs in the network. Numerical results reveal that the performance of the proposed approach is not always better than the alternatives but it offers a considerably lower backhaul load with a negligible performance loss compared to full-cell free approaches.


title: Sums of integral squares in complex bi-quadratic fields and in CM fields

abstract: Let $K$ be a complex bi-quadratic field with ring of integers $\mathcal{O}_{K}$. For $K = \mathbb{Q}(\sqrt{-m}$, $\sqrt{n}$), where $ m \equiv 3 \pmod 4 $ and $ n \equiv 1 \pmod 4$, we prove that every algebraic integer can be written as sum of integral squares. Using this, we prove that for any complex bi-quadratic field $K$, every element of $4\mathcal{O}_K$ can be written as sum of five integral squares. In addition, we show that the Pythagoras number of ring of integers of any CM field is at most five. Moreover, we give two classes of complex bi-quadratic fields for which $p(\mathcal{O}_{K})= 3$ and $p(4\mathcal{O}_{K})=3 $ respectively. Here, $p(\mathcal{O}_{K})$ is the Pythagoras number of ring of integers of $K$ and $p(4\mathcal{O}_{K})$ is the smallest positive integer $t$ such that every element of $4\mathcal{O}_{K}$ can be written as sum of $t$ integral squares.


title: Highly efficient polarization-entangled photon-pair generation in lithium niobate waveguides based on bound states in the continuum

abstract: Integrated optics provides a platform for the experimental implementation of highly complex and compact circuits for practical applications as well as for advances in the fundamental science of quantum optics. The lithium niobate (LN) waveguide is an important candidate for the construction of integrated optical circuits. Based on the bound state in the continuum (BIC) in a LN waveguide, we propose an efficient way to produce polarization-entangled photon pairs. The implementation of this method is simple and does not require the polarization process needed for periodically poled LN. The generation rate of the entangled photon pairs increases linearly with the length of the waveguide. For visible light, the generation efficiency can be improved by more than five orders of magnitude with waveguides having the length of only a few millimeters, compared with the corresponding case without BICs. The phenomena can appear in a very wide spectrum range from the visible to THz regions. This study is of great significance for the development of active integrated quantum chips in various wavelength ranges.


title: A Simple Approach for Non-stationary Linear Bandits

abstract: This paper investigates the problem of non-stationary linear bandits, where the unknown regression parameter is evolving over time. Existing studies develop various algorithms and show that they enjoy an $\widetilde{\mathcal{O}}(T^{2/3}P_T^{1/3})$ dynamic regret, where $T$ is the time horizon and $P_T$ is the path-length that measures the fluctuation of the evolving unknown parameter. In this paper, we discover that a serious technical flaw makes their results ungrounded, and then present a fix, which gives an $\widetilde{\mathcal{O}}(T^{3/4}P_T^{1/4})$ dynamic regret without modifying original algorithms. Furthermore, we demonstrate that instead of using sophisticated mechanisms, such as sliding window or weighted penalty, a simple restarted strategy is sufficient to attain the same regret guarantee. Specifically, we design an UCB-type algorithm to balance exploitation and exploration, and restart it periodically to handle the drift of unknown parameters. Our approach enjoys an $\widetilde{\mathcal{O}}(T^{3/4}P_T^{1/4})$ dynamic regret. Note that to achieve this bound, the algorithm requires an oracle knowledge of the path-length $P_T$. Combining the bandits-over-bandits mechanism by treating our algorithm as the base learner, we can further achieve the same regret bound in a parameter-free way. Empirical studies also validate the effectiveness of our approach.


title: An analysis of European crash data and scenario specification for heavy truck safety system development within the AEROFLEX project

abstract: Heavy goods vehicles (HGVs) are involved in 4.5% of police-reported road crashes in Europe and 14.2% of fatal road crashes. Active and passive safety systems can help to prevent crashes or mitigate the consequences but need detailed scenarios to be designed effectively. The aim of this paper is to give a comprehensive and up-to-date analysis of HGV crashes in Europe. The analysis is based on general statistics from CARE, results about trucks weighing 16 tons or more from national crash databases and a detailed study of in-depth crash data from GIDAS. Three scenarios are identified that should be addressed by future safety systems: (1) rear-end crashes with other vehicles in which the truck is the striking partner, (2) conflicts during right turn maneuvers of the truck and a cyclist and (3) pedestrians crossing the road perpendicular to the direction of travel of the truck.


title: Near real-time precipitable water vapour monitoring for correcting near-infrared observations using satellite remote sensing

abstract: In the search for small exoplanets orbiting cool stars whose spectral energy distributions peak in the near infrared, the strong absorption of radiation in this region due to water vapour in the atmosphere is a particularly adverse effect for the ground-based observations of cool stars. To achieve the photometric precision required to detect exoplanets in the near infrared, it is necessary to mitigate the impact of variable precipitable water vapour (PWV) on radial-velocity and photometric measurements. The aim is to enable global PWV correction by monitoring the amount of precipitable water vapour at zenith and along the line of sight of any visible target. We developed an open source Python package that uses Geostationary Operational Environmental Satellites (GOES) imagery data, which provides temperature and relative humidity at different pressure levels to compute near real-time PWV above any ground-based observatory covered by GOES every 5 minutes or 10 minutes depending on the location. We computed PWV values on selected days above Cerro Paranal (Chile) and San Pedro M\'artir (Mexico) to benchmark the procedure. We also simulated different pointing at test targets as observed from the sites to compute the PWV along the line of sight. To asses the accuracy of our method, we compared our results with the on-site radiometer measurements obtained from Cerro Paranal. Our results show that our publicly-available code proves to be a good supporting tool for measuring the local PWV for any ground-based facility within the GOES coverage, which will help in reducing correlated noise contributions in near-infrared ground-based observations that do not benefit from on-site PWV measurements.


title: BERTese: Learning to Speak to BERT

abstract: Large pre-trained language models have been shown to encode large amounts of world and commonsense knowledge in their parameters, leading to substantial interest in methods for extracting that knowledge. In past work, knowledge was extracted by taking manually-authored queries and gathering paraphrases for them using a separate pipeline. In this work, we propose a method for automatically rewriting queries into "BERTese", a paraphrase query that is directly optimized towards better knowledge extraction. To encourage meaningful rewrites, we add auxiliary loss functions that encourage the query to correspond to actual language tokens. We empirically show our approach outperforms competing baselines, obviating the need for complex pipelines. Moreover, BERTese provides some insight into the type of language that helps language models perform knowledge extraction.


title: Local field effects in ultrafast light-matter interaction measured by pump-probe spectroscopy of monolayer MoSe$_{\boldsymbol 2}$

abstract: Using a novel approach to ultrafast resonant pump-probe spectroscopy we investigate the spectral shape and dynamics of absorption features related to the A exciton in an hBN/MoSe$_2$/hBN van der Waals heterostructure. While in a pure two-level system a pump-probe experiment measures the occupation or the polarization dynamics, depending on the time ordering of the pulse pair, in the transition metal dichalcogenide (TMD) system both quantities get thoroughly mixed by strong exciton-exciton interaction. We find that for short positive delays the spectral lines experience pronounced changes in their shape and energy and they relax to the original situation on a picosecond time scale. For negative delays distinctive spectral oscillations appear indicating the first-time observation of perturbed free induction decay for a TMD system. The comparison between co-circular and cross-circular excitation schemes further allows us to investigate the rapid inter-valley scattering. By considering a three-level system as a minimal model including the local field effect, excitation induced dephasing and scattering between the excited states we explain all phenomena observed in the experiment with excellent consistency. Our handy model can be even further reduced to two levels in the case of a co-circular excitation, for which we derive analytic expressions to describe the detected signals. This allows us to trace back the spectral shapes and shifts to the impact of local field effect and excitation induced dephasing thus fully reproducing the complex behavior of the observed effects.


title: FIND: an SDR-based Tool for Fine Indoor Localization

abstract: An indoor localization approach uses Wi-Fi Access Points (APs) to estimate the Direction of Arrival (DoA) of the WiFi signals. This paper demonstrates FIND, a tool for Fine INDoor localization based on a software-defined radio, which receives Wi-Fi frames in the 80 MHz band with four antennas. To the best of our knowledge, it is the first-ever prototype that extracts from such frames data in both frequency and time domains to calculate the DoA of Wi-Fi signals in real-time. Apart from other prototypes, we retrieve from frames comprehensive information that could be used to DoA estimation: all preamble fields in the time domain, Channels State Information, and signal-to-noise ratio. Using our device, we collect a dataset for comparing different algorithms estimating the angle of arrival in the same scenario. Furthermore, we propose a novel calibration method, eliminating the constant phase shift between receiving paths caused by hardware imperfections. All calibration data, as well as a gathered dataset with various DoA in an anechoic chamber and in a classroom, are provided to facilitate further research in the area of indoor localization, intelligence surfaces, and multi-user transmissions in dense deployments.


title: Note on Long Paths in Eulerian Digraphs

abstract: Long Paths and Cycles in eulerian digraphs have gotten a lot of attention recently. In this short note, we show how to use methods from Knierim, Larcher, Martinsson, Noever (2021) to find paths of length $d/(\log d+1)$ in Eulerian digraphs with average degree $d$, improving the recent result of $\Omega(d^{1/2+1/40})$. Our result is optimal up to at most a logarithmic factor.