title: Revisiting Neighborhood-based Link Prediction for Collaborative Filtering

abstract: Collaborative filtering (CF) is one of the most successful and fundamental techniques in recommendation systems. In recent years, Graph Neural Network (GNN)-based CF models, such as NGCF [31], LightGCN [10] and GTN [9] have achieved tremendous success and significantly advanced the state-of-the-art. While there is a rich literature of such works using advanced models for learning user and item representations separately, item recommendation is essentially a link prediction problem between users and items. Furthermore, while there have been early works employing link prediction for collaborative filtering [5, 6], this trend has largely given way to works focused on aggregating information from user and item nodes, rather than modeling links directly. In this paper, we propose a new linkage (connectivity) score for bipartite graphs, generalizing multiple standard link prediction methods. We combine this new score with an iterative degree update process in the user-item interaction bipartite graph to exploit local graph structures without any node modeling. The result is a simple, non-deep learning model with only six learnable parameters. Despite its simplicity, we demonstrate our approach significantly outperforms existing state-of-the-art GNN-based CF approaches on four widely used benchmarks. In particular, on Amazon-Book, we demonstrate an over 60% improvement for both Recall and NDCG. We hope our work would invite the community to revisit the link prediction aspect of collaborative filtering, where significant performance gains could be achieved through aligning link prediction with item recommendations.


title: Asteroid Polarimetric-Phase Behavior in the Near-Infrared: S- and C-Complex Objects

abstract: We present the first results of our survey of asteroid polarization-phase curves in the near-infrared J and H bands using the WIRC+Pol instrument on the Palomar 200-inch telescope. We confirm through observations of standard stars that WIRC+Pol can reach the 0.1% precision needed for asteroid phase curve characterization, and show that C-complex asteroids could act as an alternate calibration source as they show less wavelength variation than stellar polarized standards. Initial polarization-phase curve results for S-complex asteroids show a shift in behavior as a function of wavelength from visible to near-infrared bands, extending previously observed trends. Full near-infrared polarization-phase curve characterization of individual asteroids will provide a unique constraint on surface composition of these objects by probing the wavelength dependence of albedo and index of refraction of the surface material.


title: Duality, Criticality, Anomaly, and Topology in Quantum Spin-1 Chains

abstract: In quantum spin-1 chains, there is a nonlocal unitary transformation known as the Kennedy-Tasaki transformation $U_{\text{KT}}$, which defines a duality between the Haldane phase and the $\mathbb{Z}_2 \times \mathbb{Z}_2$ symmetry-breaking phase. In this paper, we find that $U_{\text{KT}}$ also defines a duality between a topological Ising critical phase and a trivial Ising critical phase, which provides a "hidden symmetry breaking" interpretation for the topological criticality. Moreover, since the duality relates different phases of matter, we argue that a model with self-duality (i.e., invariant under $U_{\text{KT}}$) is natural to be at a critical or multicritical point. We study concrete examples to demonstrate this argument. In particular, when $H$ is the Hamiltonian of the spin-1 antiferromagnetic Heisenberg chain, we prove that the self-dual model $H + U_{\text{KT}} H U_{\text{KT}}$ is exactly equivalent to a gapless spin-$1/2$ XY chain, which also implies an emergent quantum anomaly. On the other hand, we show that the topological and trivial Ising criticalities that are dual to each other meet at a multicritical point which is indeed self-dual.

categories: cond-mat.str-el cond-mat.stat-mech hep-th quant-ph


title: Target and Task specific Source-Free Domain Adaptive Image Segmentation

abstract: Solving the domain shift problem during inference is essential in medical imaging, as most deep-learning based solutions suffer from it. In practice, domain shifts are tackled by performing Unsupervised Domain Adaptation (UDA), where a model is adapted to an unlabelled target domain by leveraging the labelled source data. In medical scenarios, the data comes with huge privacy concerns making it difficult to apply standard UDA techniques. Hence, a closer clinical setting is Source-Free UDA (SFUDA), where we have access to source-trained model but not the source data during adaptation. Existing SFUDA methods rely on pseudo-label based self-training techniques to address the domain shift. However, these pseudo-labels often have high entropy due to domain shift and adapting the source model with noisy pseudo-labels leads to sub-optimal performance. To overcome this limitation, we propose a systematic two-stage approach for SFUDA comprising of target-specific adaptation followed by task-specific adaptation. In target-specific adaptation, we enhance the pseudo-label generation by minimizing high entropy regions using the proposed ensemble entropy minimization loss and a selective voting strategy. In task-specific adaptation, we exploit the enhanced pseudo-labels using a student-teacher framework to effectively learn segmentation on the target domain. We evaluate our proposed method on 2D fundus datasets and 3D MRI volumes across 7 different domain shifts where we perform better than existing UDA and SFUDA methods for medical image segmentation. Code is available at https://github.com/Vibashan/tt-sfuda.


title: Instance Relation Graph Guided Source-Free Domain Adaptive Object Detection

abstract: Unsupervised Domain Adaptation (UDA) is an effective approach to tackle the issue of domain shift. Specifically, UDA methods try to align the source and target representations to improve the generalization on the target domain. Further, UDA methods work under the assumption that the source data is accessible during the adaptation process. However, in real-world scenarios, the labelled source data is often restricted due to privacy regulations, data transmission constraints, or proprietary data concerns. The Source-Free Domain Adaptation (SFDA) setting aims to alleviate these concerns by adapting a source-trained model for the target domain without requiring access to the source data. In this paper, we explore the SFDA setting for the task of adaptive object detection. To this end, we propose a novel training strategy for adapting a source-trained object detector to the target domain without source data. More precisely, we design a novel contrastive loss to enhance the target representations by exploiting the objects relations for a given target domain input. These object instance relations are modelled using an Instance Relation Graph (IRG) network, which are then used to guide the contrastive representation learning. In addition, we utilize a student-teacher based knowledge distillation strategy to avoid overfitting to the noisy pseudo-labels generated by the source-trained model. Extensive experiments on multiple object detection benchmark datasets show that the proposed approach is able to efficiently adapt source-trained object detectors to the target domain, outperforming previous state-of-the-art domain adaptive detection methods. Code and models are provided in \href{https://viudomain.github.io/irg-sfda-web/}{https://viudomain.github.io/irg-sfda-web/}.


title: CHEX: CHannel EXploration for CNN Model Compression

abstract: Channel pruning has been broadly recognized as an effective technique to reduce the computation and memory cost of deep convolutional neural networks. However, conventional pruning methods have limitations in that: they are restricted to pruning process only, and they require a fully pre-trained large model. Such limitations may lead to sub-optimal model quality as well as excessive memory and training cost. In this paper, we propose a novel Channel Exploration methodology, dubbed as CHEX, to rectify these problems. As opposed to pruning-only strategy, we propose to repeatedly prune and regrow the channels throughout the training process, which reduces the risk of pruning important channels prematurely. More exactly: From intra-layer's aspect, we tackle the channel pruning problem via a well known column subset selection (CSS) formulation. From inter-layer's aspect, our regrowing stages open a path for dynamically re-allocating the number of channels across all the layers under a global channel sparsity constraint. In addition, all the exploration process is done in a single training from scratch without the need of a pre-trained large model. Experimental results demonstrate that CHEX can effectively reduce the FLOPs of diverse CNN architectures on a variety of computer vision tasks, including image classification, object detection, instance segmentation, and 3D vision. For example, our compressed ResNet-50 model on ImageNet dataset achieves 76% top1 accuracy with only 25% FLOPs of the original ResNet-50 model, outperforming previous state-of-the-art channel pruning methods. The checkpoints and code are available at here .


title: Not Another School Resource Map: Meeting Underserved Families' Information Needs Requires Trusting Relationships and Personalized Care

abstract: Public school districts across the United States have implemented school choice systems that have the potential to improve underserved students' access to educational opportunities. However, research has shown that learning about and applying for schools can be extremely time-consuming and expensive, making it difficult for these systems to create more equitable access to resources in practice. A common factor surfaced in prior work is unequal access to information about the schools and enrollment process. In response, governments and non-profits have invested in providing more information about schools to parents, for instance, through detailed online dashboards. However, we know little about what information is actually useful for historically marginalized and underserved families. We conducted interviews with 10 low-income families and families of color to learn about the challenges they faced navigating an online school choice and enrollment system. We complement this data with four interviews with people who have supported families through the enrollment process in a wide range of roles, from school principal to non-profit staff ("parent advocates"). Our findings highlight the value of personalized support and trusting relationships to delivering relevant and helpful information. We contrast this against online information resources and dashboards, which tend to be impersonal, target a broad audience, and make strong assumptions about what parents should look for in a school without sensitivity to families' varying circumstances. We advocate for an assets-based design approach to information support in public school enrollment, which would ask how we can support the local, one-on-one support that community members already provide.


title: Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech Recognition

abstract: An unsupervised text-to-speech synthesis (TTS) system learns to generate speech waveforms corresponding to any written sentence in a language by observing: 1) a collection of untranscribed speech waveforms in that language; 2) a collection of texts written in that language without access to any transcribed speech. Developing such a system can significantly improve the availability of speech technology to languages without a large amount of parallel speech and text data. This paper proposes an unsupervised TTS system based on an alignment module that outputs pseudo-text and another synthesis module that uses pseudo-text for training and real text for inference. Our unsupervised system can achieve comparable performance to the supervised system in seven languages with about 10-20 hours of speech each. A careful study on the effect of text units and vocoders has also been conducted to better understand what factors may affect unsupervised TTS performance. The samples generated by our models can be found at https://cactuswiththoughts.github.io/UnsupTTS-Demo, and our code can be found at https://github.com/lwang114/UnsupTTS.


title: Convergence of First-Order Methods for Constrained Nonconvex Optimization with Dependent Data

abstract: We focus on analyzing the classical stochastic projected gradient methods under a general dependent data sampling scheme for constrained smooth nonconvex optimization. We show the worst-case rate of convergence $\tilde{O}(t^{-1/4})$ and complexity $\tilde{O}(\varepsilon^{-4})$ for achieving an $\varepsilon$-near stationary point in terms of the norm of the gradient of Moreau envelope and gradient mapping. While classical convergence guarantee requires i.i.d. data sampling from the target distribution, we only require a mild mixing condition of the conditional distribution, which holds for a wide class of Markov chain sampling algorithms. This improves the existing complexity for the constrained smooth nonconvex optimization with dependent data from $\tilde{O}(\varepsilon^{-8})$ to $\tilde{O}(\varepsilon^{-4})$ with a significantly simpler analysis. We illustrate the generality of our approach by deriving convergence results with dependent data for stochastic proximal gradient methods, adaptive stochastic gradient algorithm AdaGrad and stochastic gradient algorithm with heavy ball momentum. As an application, we obtain first online nonnegative matrix factorization algorithms for dependent data based on stochastic projected gradient methods with adaptive step sizes and optimal rate of convergence.


title: DRaCoN -- Differentiable Rasterization Conditioned Neural Radiance Fields for Articulated Avatars

abstract: Acquisition and creation of digital human avatars is an important problem with applications to virtual telepresence, gaming, and human modeling. Most contemporary approaches for avatar generation can be viewed either as 3D-based methods, which use multi-view data to learn a 3D representation with appearance (such as a mesh, implicit surface, or volume), or 2D-based methods which learn photo-realistic renderings of avatars but lack accurate 3D representations. In this work, we present, DRaCoN, a framework for learning full-body volumetric avatars which exploits the advantages of both the 2D and 3D neural rendering techniques. It consists of a Differentiable Rasterization module, DiffRas, that synthesizes a low-resolution version of the target image along with additional latent features guided by a parametric body model. The output of DiffRas is then used as conditioning to our conditional neural 3D representation module (c-NeRF) which generates the final high-res image along with body geometry using volumetric rendering. While DiffRas helps in obtaining photo-realistic image quality, c-NeRF, which employs signed distance fields (SDF) for 3D representations, helps to obtain fine 3D geometric details. Experiments on the challenging ZJU-MoCap and Human3.6M datasets indicate that DRaCoN outperforms state-of-the-art methods both in terms of error metrics and visual quality.


title: StyleT2I: Toward Compositional and High-Fidelity Text-to-Image Synthesis

abstract: Although progress has been made for text-to-image synthesis, previous methods fall short of generalizing to unseen or underrepresented attribute compositions in the input text. Lacking compositionality could have severe implications for robustness and fairness, e.g., inability to synthesize the face images of underrepresented demographic groups. In this paper, we introduce a new framework, StyleT2I, to improve the compositionality of text-to-image synthesis. Specifically, we propose a CLIP-guided Contrastive Loss to better distinguish different compositions among different sentences. To further improve the compositionality, we design a novel Semantic Matching Loss and a Spatial Constraint to identify attributes' latent directions for intended spatial region manipulations, leading to better disentangled latent representations of attributes. Based on the identified latent directions of attributes, we propose Compositional Attribute Adjustment to adjust the latent code, resulting in better compositionality of image synthesis. In addition, we leverage the $\ell_2$-norm regularization of identified latent directions (norm penalty) to strike a nice balance between image-text alignment and image fidelity. In the experiments, we devise a new dataset split and an evaluation metric to evaluate the compositionality of text-to-image synthesis models. The results show that StyleT2I outperforms previous approaches in terms of the consistency between the input text and synthesized images and achieves higher fidelity.


title: Engineering ideal helical topological networks in stanene via Zn decoration

abstract: The xene family of topological insulators plays a key role in many proposals for topological electronic, spintronic, and valleytronic devices. These proposals rely on applying local perturbations, including electric fields and proximity magnetism, to induce topological phase transitions in xenes. However, these techniques lack control over the geometry of interfaces between topological regions, a critical aspect of engineering topological devices. We propose adatom decoration as a method for engineering atomically precise topological edge modes in xenes. Our first-principles calculations show that decorating stanene with Zn adatoms exclusively on one of two sublattices induces a topological phase transition from the quantum spin Hall (QSH) to quantum valley Hall (QVH) phase and confirm the existence of spin-valley polarized edge modes propagating at QSH/QVH interfaces. We conclude by discussing technological applications of these edge modes that are enabled by the atomic precision afforded by recent advances in adatom manipulation technology.


title: Current-enabled optical conductivity of superconductors

abstract: In most superconductors, optical excitations require impurity scattering or the presence of multiple bands. This is because in clean single-band superconductors, the combination of particle-hole and inversion symmetries prevents momentum-conserving transitions. In this work we show how the flow of supercurrent can lead to new contributions to optical conductivity. As supercurrent breaks inversion symmetry, transitions across the superconducting gap become allowed even in clean superconductors and dominate over impurity-induced contributions for energies comparable to the gap width. The response is dependent on the nature of the underlying normal state as well as on the type of superconducting order. Through use of the screening supercurrent with controllable magnitude and direction, that arises from an external magnetic field, this enables a detailed investigation of the superconducting state and possible gap symmetry determination in unconventional superconductors for which other techniques have not been practicable.


title: Shift-Robust Node Classification via Graph Adversarial Clustering

abstract: Graph Neural Networks (GNNs) are de facto node classification models in graph structured data. However, during testing-time, these algorithms assume no data shift, i.e., $\Pr_\text{train}(X,Y) = \Pr_\text{test}(X,Y)$. Domain adaption methods can be adopted for data shift, yet most of them are designed to only encourage similar feature distribution between source and target data. Conditional shift on classes can still affect such adaption. Fortunately, graph yields graph homophily across different data distributions. In response, we propose Shift-Robust Node Classification (SRNC) to address these limitations. We introduce an unsupervised cluster GNN on target graph to group the similar nodes by graph homophily. An adversarial loss with label information on source graph is used upon clustering objective. Then a shift-robust classifier is optimized on training graph and adversarial samples on target graph, which are generated by cluster GNN. We conduct experiments on both open-set shift and representation-shift, which demonstrates the superior accuracy of SRNC on generalizing to test graph with data shift. SRNC is consistently better than previous SoTA domain adaption algorithm on graph that progressively use model predictions on target graph for training.


title: Dose Finding Studies for Therapies with Late-Onset Safety and Efficacy Outcomes

abstract: In Phase I/II dose-finding trials, the objective is to find the Optimal Biological Dose (OBD), a dose that is both safe and efficacious that maximises some optimality criterion based on safety and efficacy. This is further complicated when the investigated treatment consists of multiple cycles of therapy, and both toxicity and efficacy outcomes may occur at any point throughout the follow up of multiple cycles. In this work we present the Joint TITE-CRM, a model-based design for late onset toxicities and efficacies based on the well-known TITE-CRM. It is found to be superior to both currently available alternative designs that account for late onset bivariate outcomes; a model-assisted method and a bivariate survival design, as well as being both intuitive and computationally feasible.


title: Improving The Diagnosis of Thyroid Cancer by Machine Learning and Clinical Data

abstract: Thyroid cancer is a common endocrine carcinoma that occurs in the thyroid gland. Much effort has been invested in improving its diagnosis, and thyroidectomy remains the primary treatment method. A successful operation without unnecessary side injuries relies on an accurate preoperative diagnosis. Current human assessment of thyroid nodule malignancy is prone to errors and may not guarantee an accurate preoperative diagnosis. This study proposed a machine framework to predict thyroid nodule malignancy based on a novel clinical dataset we collected. The 10-fold cross-validation, bootstrap analysis, and permutation predictor importance were applied to estimate and interpret the model performance under uncertainty. The comparison between model prediction and expert assessment shows the advantage of our framework over human judgment in predicting thyroid nodule malignancy. Our method is accurate, interpretable, and thus useable as additional evidence in the preoperative diagnosis for thyroid cancer.


title: A Metaheuristic Algorithm for Large Maximum Weight Independent Set Problems

abstract: Motivated by a real-world vehicle routing application, we consider the maximum-weight independent set problem: Given a node-weighted graph, find a set of independent (mutually nonadjacent) nodes whose node-weight sum is maximum. Some of the graphs airsing in this application are large, having hundreds of thousands of nodes and hundreds of millions of edges. To solve instances of this size, we develop a new local search algorithm, which is a metaheuristic in the greedy randomized adaptive search (GRASP) framework. This algorithm, which we call METAMIS, uses a wider range of simple local search operations than previously described in the literature. We introduce data structures that make these operations efficient. A new variant of path-relinking is introduced to escape local optima and so is a new alternating augmenting-path local search move that improves algorithm performance. We compare an implementation of our algorithm with a state-of-the-art openly available code on public benchmark sets, including some large instances with hundreds of millions of vertices. Our algorithm is, in general, competitive and outperforms this openly available code on large vehicle routing instances. We hope that our results will lead to even better MWIS algorithms.


title: Bayesian Photonic Accelerators for Energy Efficient and Noise Robust Neural Processing

abstract: Artificial neural networks are efficient computing platforms inspired by the brain. Such platforms can tackle a vast area of real-life tasks ranging from image processing to language translation. Silicon photonic integrated chips (PICs), by employing coherent interactions in Mach-Zehnder interferometers, are promising accelerators offering record low power consumption and ultra-fast matrix multiplication. Such photonic accelerators, however, suffer from phase uncertainty due to fabrication errors and crosstalk effects that inhibit the development of high-density implementations. In this work, we present a Bayesian learning framework for such photonic accelerators. In addition to the conventional log-likelihood optimization path, two novel training schemes are derived, namely a regularized version and a fully Bayesian learning scheme. They are applied on a photonic neural network with 512 phase shifters targeting the MNIST dataset. The new schemes, when combined with a pre-characterization stage that provides the passive offsets, are able to dramatically decrease the operational power of the PIC beyond 70%, with just a slight loss in classification accuracy. The full Bayesian scheme, apart from this energy reduction, returns information with respect to the sensitivity of the phase shifters. This information is used to de-activate 31% of the phase actuators and, thus, significantly simplify the driving system.


title: High Speed Photonic Neuromorphic Computing Using Recurrent Optical Spectrum Slicing Neural Networks

abstract: Neuromorphic Computing implemented in photonic hardware is one of the most promising routes towards achieving machine learning processing at the picosecond scale, with minimum power consumption. In this work, we present a new concept for realizing photonic recurrent neural networks and reservoir computing architectures with the use of recurrent optical spectrum slicing. This is accomplished through simple optical filters placed in an loop, where each filter processes a specific spectral slice of the incoming optical signal. The synaptic weights in our scheme are equivalent to filters central frequencies and bandwidths. This new method for implementing recurrent neural processing in the photonic domain, which we call Recurrent Optical Spectrum Slicing Neural Networks, is numerically evaluated on a demanding, industry-relevant task such as high baud rate optical signal equalization 100 Gbaud, exhibiting ground-breaking performance. The performance enhancement surpasses state-of-the-art digital processing techniques by doubling the reach while minimizing complexity and power consumption by a factor of 10 compared to state-of-the-art solutions. In this respect, ROSS-NNs can pave the way for the implementation of ultra-efficient photonic hardware accelerators tailored for processing high-bandwidth optical signals in optical communication and high-speed imaging applications


title: On gravitational preheating

abstract: We consider dark matter production during the inflaton oscillation epoch. It is conceivable that renormalizable interactions between dark matter and inflaton may be negligible. In this case, the leading role is played by higher dimensional operators generated by gravity and thus suppressed by the Planck scale. We focus on dim-6 operators and study the corresponding particle production in perturbative and non-perturbative regimes. We find that the dark matter production rate is dominated by non-derivative operators involving higher powers of the inflaton field. Even if they appear with small Wilson coefficients, such operators can readily account for the correct dark matter abundance.


title: The relation between accretion rate and jet power in early-type galaxies with thermally unstable hot atmospheres

abstract: We use Chandra X-ray data and Very Large Array radio observations for a sample of 20 nearby, massive, X-ray bright, early-type galaxies to investigate the relation between the Bondi accretion rates and the mechanical jet powers. We find a strong correlation ($\rho = 0.96^{+0.03}_{-0.09}$; BF$_{10} > 100$) between the Bondi accretion power, $P_{\text{Bondi}}$, and the mechanical jet power, $P_{\text{jet}}$, for a subsample of 14 galaxies, which also host cool H$\alpha$+[NII] line emitting gas and thus likely have thermally unstable atmospheres. The relation between the Bondi accretion power and the mechanical jet power for this subsample is well described by a power-law model $\log \frac{P_{\mathrm{Bondi}}}{{10^{43} \, \mathrm{erg \, s^{-1}}}} = \alpha + \beta \log \frac{P_{\mathrm{jet}}}{{10^{43} \, \mathrm{erg \, s^{-1}}}}$, where $\alpha = 1.10 \pm 0.25$ and $\beta = 1.10 \pm 0.24$ with an intrinsic scatter $\sigma = 0.08^{+0.14}_{-0.06}$ dex. The results indicate that in all galaxies with thermally unstable atmospheres the cooling atmospheric gas feeds the central black holes at a similar jet-to-Bondi power ratio. For the full sample of 20 galaxies, the correlation is weaker and in a subset of galaxies with no signs of H$\alpha$+[NII] emission, we see a hint for a systematically lower jet-to-Bondi power ratio. We also investigate the dependence of jet power on individual quantities in the Bondi formula such as the supermassive black hole mass ($M_{\bullet}$) and the specific entropy of the gas ($K$) at the Bondi radius. For the subsample of H$\alpha$+[NII] emitting galaxies, we find a very tight correlation of $P_{\text{jet}}$ with $M_{\bullet}$ ($\rho = 0.91^{+0.06}_{-0.11}$; BF$_{10} > 100$) and, although poorly constrained, a hint of an anti-correlation for $P_{\text{jet}}$ and $K$ ($\rho = -0.47^{+0.60}_{-0.37}$; BF$_{10} = 1.1$).


title: Prospects for precise predictions of $a_\mu$ in the Standard Model

abstract: We discuss the prospects for improving the precision on the hadronic corrections to the anomalous magnetic moment of the muon, and the plans of the Muon $g-2$ Theory Initiative to update the Standard Model prediction.


title: Kiloparsec-scale imaging of the CO(1-0)-traced cold molecular gas reservoir in a z~3.4 submillimeter galaxy

abstract: We present a high-resolution study of the cold molecular gas as traced by CO(1-0) in the unlensed z$\sim$3.4 submillimeter galaxy SMM J13120+4242, using multi-configuration observations with the Karl G. Jansky Very Large Array (JVLA). The gas reservoir, imaged on 0.39" ($\sim$3 kpc) scales, is resolved into two components separated by $\sim$11 kpc with a total extent of 16 $\sim$3 kpc. Despite the large spatial extent of the reservoir, the observations show a CO(1-0) FWHM linewidth of only 267 $\pm$ 64 km s$^{-1}$. We derive a revised line luminosity of L'$_\mathrm{CO(1-0)}$ = (10 $\pm$ 3) $\times$ 10$^{10}$ K km s$^{-1}$ pc$^2$ and a molecular gas mass of M$_\mathrm{gas}$ = (13 $\pm$ 3) $\times$ 10$^{10}$ ($\alpha_\mathrm{CO}$/1) M$_{\odot}$. Despite the presence of a velocity gradient (consistent with previous resolved CO(6-5) imaging), the CO(1-0) imaging shows evidence for significant turbulent motions which are preventing the gas from fully settling into a disk. The system likely represents a merger in an advanced stage. Although the dynamical mass is highly uncertain, we use it to place an upper limit on the CO-to-H$_2$ mass conversion factor $\alpha_\mathrm{CO}$ of 1.4. We revisit the SED fitting, finding that this galaxy lies on the very massive end of the main sequence at z = 3.4. Based on the low gas fraction, short gas depletion time and evidence for a central AGN, we propose that SMM J13120 is in a rapid transitional phase between a merger-driven starburst and an unobscured quasar. The case of SMM J13120 highlights the how mergers may drive important physical changes in galaxies without pushing them off the main sequence.


title: Axion signatures from supernova explosions through the nucleon electric-dipole portal

abstract: We consider axions coupled to nucleons and photons only through the nucleon electric-dipole moment (EDM) portal. This coupling is a model-independent feature of QCD axions, which solve the strong CP problem, and might arise as well in more general axion-like particle setups. We revise the supernova (SN) axion emission induced by the nucleon EDM coupling and refine accordingly the SN 1987A bound. Furthermore, we calculate the axion flux from a future Galactic SN and show that it might produce a peculiar and potentially detectable gamma-ray signal in a large underground neutrino detector such as the proposed Hyper-Kamiokande. The possibility to detect such a signal offers a way to search for an oscillating nucleon EDM complementary to CASPERe, without relying on the assumption that axions are a sizeable component of the dark matter. Furthermore, if axions from SN produce an observable signal, they could also lead to an amount of cosmological extra-radiation observable in future cosmic surveys.


title: Glueballs in a Thermal Squeezeout Model

abstract: It has been shown that a first order confinement phase transition can drastically change the relic dark matter abundance in confining dark sectors with only heavy dark quarks. We study the phenomenology of one such model with a Z' portal to Standard Model. We find that dark glueballs are long-lived in this setup and dilute the dark matter abundance after their decay to Standard Model. With this effect, the correct relic abundance is obtained with dark matter masses up to $\mathcal{O}(10^6)$~TeV. We find that while a part of the parameter space is already ruled out by direct detection and collider searches, there is still a broad space of viable scenarios that can be probed by future experiments.


title: Self-ionizing galactic winds

abstract: We present hydrodynamical simulations of galactic winds from star-forming galaxies including non-equilibrium ionization and frequency-dependent radiative transfer, processes that have remained largely unaccounted for in galactic wind studies. We consider radiation from massive stars, the metagalactic UV/X-ray background, and the self-radiation of the supernovae heated gas. We compare our results to classical galactic wind solutions and show the importance of our newly included physical processes toward observations of ions such as O III, O VI, O VII and O VIII plus the observable soft X-ray spectra. Non-equilibrium ionization is reflected in over-ionized gas compared to equilibrium solutions, leading to much enhanced column densities of highly ionized species. The wind produces excess soft X-ray ($E\gtrsim 100$ eV) radiation that is several orders of magnitude higher compared to the metagalactic background. This radiation ionizes the higher ions (such as O VII) somewhat, but affects the lower ions (such as O III) significantly. We predict that the observable X-ray spectra should contain the signatures of such non-equilibrium effects, especially in X-ray lines such as O VII and O VIII. Simple estimates suggest that both the temperature and density of the winds may be overestimated by factors of a few to almost 2 orders of magnitude using simple equilibrium models. We conclude that both the non-equilibrium ionization and the radiation from the wind itself need to be considered for proper modeling of the optical/UV/X-ray emitting plasma in galactic winds.


title: Four-mode squeezed states in de Sitter space: A study with two field interacting quantum system

abstract: In this paper we study the application of four-mode squeezed states in the cosmological context, studying two weakly coupled scalar fields in the planar patch of the de Sitter space. We construct the four-mode squeezed state formalism and connect this concept with the Hamiltonian of the two coupled inverted harmonic oscillators having a time-dependent effective frequency in the planar patch of the de Sitter space. Further, the corresponding evolution operator for the quantum Euclidean vacuum state has been constructed, which captures its dynamics. Using the Heisenberg picture coupled differential equations describing the time evolution for all squeezing parameters (amplitude, phase and angle) have been obtained, for the weakly coupled two scalar field model. With the help of these evolutions for the coupled system, we simulate the dynamics of the squeezing parameters in terms of conformal time. From our analysis, we observe interesting dynamics, which helps us to explore various underlying physical implications of the weakly coupled two scalar field system in the planar patch of the de Sitter cosmological background.


title: Fano 3-Folds, Reflexive Polytopes and Brane Brick Models

abstract: Reflexive polytopes in n dimensions have attracted much attention both in mathematics and theoretical physics due to their connection to Fano n-folds and mirror symmetry. This work focuses on the 18 regular reflexive polytopes corresponding to smooth Fano 3-folds. For the first time, we show that all 18 regular reflexive polytopes have corresponding 2d (0,2) gauge theories realized by brane brick models. These 2d gauge theories can be considered as the worldvolume theories of D1-branes probing the toric Calabi-Yau 4-singularities whose toric diagrams are given by the associated regular reflexive polytopes. The generators of the mesonic moduli space of the brane brick models are shown to form a lattice of generators due to the charges under the rank 3 mesonic flavor symmetry. It is shown that the lattice of generators is the exact polar dual reflexive polytope to the corresponding toric diagram of the brane brick model. This duality not only highlights the close relationship between the geometry and 2d gauge theory, but also opens up pathways towards new discoveries in relation to reflexive polytopes and brane brick models.


title: Altered Axion Abundance from a Dynamical Peccei-Quinn Scale

abstract: We build a model in which the relic abundance of axions is altered from the standard misalignment mechanism, either increased or decreased, due to the presence of a new light scalar that couples to the radial part of the Peccei-Quinn (PQ) field. The light scalar makes the effective PQ symmetry-breaking scale dynamical, altering the early-time dynamics for the axion and affecting its late-time dark matter abundance. We analyze this new mechanism semianalytically and numerically, showing that we can accommodate both lighter or heavier axion dark matter, compared to the standard treatments. We discuss implications of the model for axion searches and fundamental physics.


title: Type IIB flux compactifications with $h^{1,1}=0$

abstract: We revisit flux compactifications of type IIB string theory on `spaces' dual to rigid Calabi-Yau manifolds. This rather unexplored part of the string landscapes harbors many interesting four-dimensional solutions, namely supersymmetric $\mathcal{N}=1$ Minkowski vacua without flat direction and infinite families of AdS vacua, some potentially with unrestricted rank for the gauge group. We also comment on the existence of metastable dS solutions in this setup. We discuss how these solutions fit into the web of swampland conjectures.


title: Coincidence between morphology and star-formation activity through cosmic time: the impact of the bulge growth

abstract: The origin of the quenching in galaxies is still highly debated. Different scenarios and processes are proposed. We use multi-band (400-1600 nm) bulge-disc decompositions of massive galaxies in the redshift range 0<z<2 to explore the distribution and the evolution of galaxies in the log SFR-logM* plane as a function of the stellar mass-weighted bulge-to-total ratio (BTM) and also for internal galaxy components (bulge/disc) separately. We find evidence of a clear link between the presence of a bulge and the flattening of the Main Sequence in the high-mass end. All bulgeless galaxies (BTM<0.2) lie on the main-sequence, and there is little evidence of a quenching channel without bulge growth. Galaxies with a significant bulge component (BTM>0.2) are equally distributed in number between star forming and passive regions. The vast majority of bulges in the Main Sequence galaxies are quiescent, while star formation is localized in the disc component. Our current findings underline a strong correlation between the presence of the bulge and the star formation state of the galaxy. A bulge, if present, is often quiescent, independently of the morphology or the star formation activity of the host galaxy. Additionally, if a galaxy is quiescent, with a large probability, is hosting a bulge. Conversely, if the galaxy has a disky shape is highly probable to be star forming.


title: BPS coherent states and localization

abstract: We introduce coherent states averaged over a gauge group action to study correlators of half BPS states in ${\cal N}=4 $ SYM theory. The overlaps of these averaged coherent states are a generating function of correlators and can be written in terms of the Harish-Chandra-Itzykzon-Zuber (HCIZ) integral. We show that this formula immediately leads to a computation of the normalization of two point functions in terms of characters obtained originally in the work of Corley, Jevicki and Ramgoolam. We also find various generalizations for $A_{n-1}$ quivers that follow directly from other solvable integrals over unitary groups. All of these can be computed using localization methods. When we promote the parameters of the generating function to collective coordinates, there is a dominant saddle that controls the effective action of these coherent states in the regime where they describe single AdS giant gravitons. We also discuss how to add open strings to this formulation. These will produce calculations that rely on correlators of matrix components of unitaries in the ensemble that is determined by the HCIZ integral to determine anomalous dimensions. We also discuss how sphere giants arise from Grassman integrals, how one gets a dominant saddle and how open strings are added in that case. The fact that there is a dominant saddle helps to understand how a $1/N$ expansion arises for open strings. We generalize the coherent state idea to study $1/4$ and $1/8$ BPS states as more general integrals over unitary groups.


title: Comment on "Poynting vector controversy in axion modified electrodynamics"

abstract: In a recent publication, Tobar, McAllister, and Goryachev claim that using an alternative definition of the Poynting vector can dramatically enhance the sensitivity of their proposed axion dark matter detector. While the choice of Poynting vector is indeed ambiguous, it cannot affect physical results, such as the reading on a voltmeter, as long as the same definition is used consistently. I explain this point in detail, and locate the specific errors in their calculation.


title: The Fornax3D project: discovery of ancient massive merger events in the Fornax cluster galaxies NGC 1380 and NGC 1427

abstract: We report the discovery of ancient massive merger events in the early-type galaxies NGC 1380 and NGC 1427, members of the Fornax galaxy cluster. Both galaxies have been observed by the MUSE IFU instrument on the VLT, as part of the Fornax3D project. By fitting recently-developed population-orbital superposition models to the observed surface brightness as well as stellar kinematic, age, and metallicity maps, we obtain the stellar orbits, age and metallicity distributions of each galaxy. We then decompose each galaxy into multiple orbital-based components, including a dynamically hot inner stellar halo component which is identified as the relic of past massive mergers. By comparing to analogues from cosmological galaxy simulations, chiefly TNG50, we find that the formation of such a hot inner stellar halo requires the merger with a now-destroyed massive satellite galaxy of $3.7_{-1.5}^{+2.7} \times 10^{10}$ Msun (about $1/5$ of its current stellar mass) in the case of NGC 1380 and of $1.5_{-0.7}^{+1.6} \times10^{10}$ Msun (about $1/4$ of its current stellar mass) in the case of NGC 1427. Moreover, we infer that the last massive merger in NGC 1380 happened $\sim10$ Gyr ago based on the stellar age distribution of the re-grown dynamically cold disk, whereas the merger in NGC 1427 ended $t\lesssim 8$ Gyr ago based on the stellar populations in its hot inner stellar halo. The major merger event in NGC 1380 is the first one with both merger mass and merger time quantitatively inferred in a galaxy beyond the Local Volume. Moreover, it is the oldest and most massive merger uncovered in nearby galaxies so far.


title: Semi-supervised Graph Neural Networks for Pileup Noise Removal

abstract: The high instantaneous luminosity of the CERN Large Hadron Collider leads to multiple proton-proton interactions in the same or nearby bunch crossings (pileup). Advanced pileup mitigation algorithms are designed to remove this noise from pileup particles and improve the performance of crucial physics observables. This study implements a semi-supervised graph neural network for particle-level pileup noise removal, by identifying individual particles produced from pileup. The graph neural network is firstly trained on charged particles with known labels, which can be obtained from detector measurements on data or simulation, and then inferred on neutral particles for which such labels are missing. This semi-supervised approach does not depend on the ground truth information from simulation and thus allows us to perform training directly on experimental data. The performance of this approach is found to be consistently better than widely-used domain algorithms and comparable to the fully-supervised training using simulation truth information. The study serves as the first attempt at applying semi-supervised learning techniques to pileup mitigation, and opens up a new direction of fully data-driven machine learning pileup mitigation studies.


title: A Rapid and Large-Amplitude X-ray Dimming Event in a z ~ 2.6 Radio-Quiet Quasar

abstract: We report a dramatic fast X-ray dimming event in a z=2.627 radio-quiet type 1 quasar, which has an estimated supermassive black hole (SMBH) mass of $6.3\times 10^{9} M_\odot$. In the high X-ray state, it showed a typical level of X-ray emission relative to its UV/optical emission. Then its 0.5-2 keV (rest-frame 1.8-7.3 keV) flux dropped by a factor of $\approx7.6$ within two rest-frame days. The dimming is associated with spectral hardening, as the 2-7 keV (rest-frame 7.3-25.4 keV) flux dropped by only $17\%$ and the effective power-law photon index of the X-ray spectrum changed from $\approx2.3$ to $\approx0.9$. The quasar has an infrared (IR)-to-UV spectral energy distribution and a rest-frame UV spectrum similar to those of typical quasars, and it does not show any significant long-term variability in the IR and UV/optical bands. Such an extremely fast and large-amplitude X-ray variability event has not been reported before in luminous quasars with such massive SMBHs. The X-ray dimming is best explained by a fast-moving absorber crossing the line of sight and fully covering the X-ray emitting corona. Adopting a conservatively small size of $5 {G} M_{\rm BH}/c^2$ for the X-ray corona, the transverse velocity of the absorber is estimated to be $\approx 0.9c$. The quasar is likely accreting with a high or even super-Eddington accretion rate, and the high-velocity X-ray absorber is probably related to a powerful accretion-disk wind. Such an energetic wind may eventually evolve into a massive galactic-scale outflow, providing efficient feedback to the host galaxy.


title: The molecular gas properties in local Seyfert 2 galaxies

abstract: We present a multi-wavelength study of the molecular gas properties of a sample of local Seyfert 2 galaxies to assess if, and to what extent, the presence of an active galactic nucleus (AGN) can affect the Interstellar Medium (ISM) properties in a sample of 33 local Seyfert 2 galaxies. We compare the molecular gas content (MH2), derived from new and archival low-J CO line measurements of a sample of AGN and a control sample of star-forming galaxies (SFGs). Both the AGN and the control sample are characterised in terms of host-galaxy properties (e.g., stellar and dust masses, Mstar and Mdust, respectively; and star formation rate, SFR). We also investigate the effect of AGN activity onto the emission of polycyclic aromatic hydrocarbon (PAH) molecules in the mid-infrared (MIR), a waveband where the dust-reprocessed emission from the obscured AGN contributes the most. The AGN hosted in less massive galaxies (i.e., log(Mstar/Msun)<10.5; log(Mdust/Msun)<7.5) show larger molecular gas content with respect to SFGs matched in stellar and dust mass. When comparing their depletion time(tdep~MH2/SFR), AGN show tdep~0.3-1.0 Gyr, similar to those observed in the control sample of SFGs. Seyfert 2 galaxies show fainter PAH luminosity at increasingly larger dominance of the nuclear activity in the MIR. We find no clear evidence for a systematic reduction of the molecular gas reservoir at galactic scale in Seyfert galaxies with respect to SFGs. This is in agreement with recent studies showing that molecular gas content only is reduced in regions of sub-kpc size, where the emission from the accreting supermassive black hole dominates. Nonetheless, we show that the impact of AGN activity on the ISM is clearly visible as suppression of the PAH luminosity.


title: The TESS Triple-9 Catalog: 999 uniformly vetted candidate exoplanets

abstract: The Transiting Exoplanet Survey Satellite (TESS) has detected thousands of exoplanet candidates since 2018, most of which have yet to be confirmed. A key step in the confirmation process of these candidates is ruling out false positives through vetting. Vetting also eases the burden on follow-up observations, provides input for demographics studies, and facilitates training machine learning algorithms. Here we present the TESS Triple-9 (TT9) catalog -- a uniformly-vetted catalog containing dispositions for 999 exoplanet candidates listed on ExoFOP-TESS, known as TESS Objects of Interest (TOIs). The TT9 was produced using the Discovery And Vetting of Exoplanets pipeline, DAVE, and utilizing the power of citizen science as part of the Planet Patrol project. More than 70% of the TOIs listed in the TT9 pass our diagnostic tests, and are thus marked as true planetary candidates. We flagged 144 candidates as false positives, and identified 146 as potential false positives. At the time of writing, the TT9 catalog contains ~20% of the entire ExoFOP-TESS TOIs list, demonstrates the synergy between automated tools and citizen science, and represents the first stage of our efforts to vet all TOIs. The DAVE generated results are publicly available on ExoFOP-TESS.


title: LinkBERT: Pretraining Language Models with Document Links

abstract: Language model (LM) pretraining can learn various knowledge from text corpora, helping downstream tasks. However, existing methods such as BERT model a single document, and do not capture dependencies or knowledge that span across documents. In this work, we propose LinkBERT, an LM pretraining method that leverages links between documents, e.g., hyperlinks. Given a text corpus, we view it as a graph of documents and create LM inputs by placing linked documents in the same context. We then pretrain the LM with two joint self-supervised objectives: masked language modeling and our new proposal, document relation prediction. We show that LinkBERT outperforms BERT on various downstream tasks across two domains: the general domain (pretrained on Wikipedia with hyperlinks) and biomedical domain (pretrained on PubMed with citation links). LinkBERT is especially effective for multi-hop reasoning and few-shot QA (+5% absolute improvement on HotpotQA and TriviaQA), and our biomedical LinkBERT sets new states of the art on various BioNLP tasks (+7% on BioASQ and USMLE). We release our pretrained models, LinkBERT and BioLinkBERT, as well as code and data at https://github.com/michiyasunaga/LinkBERT.


title: Adaptive Multi-User Clustering and Power Allocation for NOMA Systems with Imperfect SIC

abstract: Non-orthogonal multiple access (NOMA) is recognized as a promising radio access technique for the next generation wireless systems. We consider a practical downlink NOMA system with imperfect successive interference cancellation and derive bounds on the power allocation factors for a given number of users in each cluster. We propose a minimum signal-to-interference-plus-noise ratio difference criterion between two successive NOMA users in a cluster of users to achieve higher rates than an equivalent orthogonal multiple access (OMA) system. We then propose adaptive multi-user clustering and power allocation algorithms for downlink NOMA systems. Through extensive simulations, we show that the proposed algorithms achieve higher rates than the state-of-the-art algorithms.


title: An EEG-Based Multi-Modal Emotion Database with Both Posed and Authentic Facial Actions for Emotion Analysis

abstract: Emotion is an experience associated with a particular pattern of physiological activity along with different physiological, behavioral and cognitive changes. One behavioral change is facial expression, which has been studied extensively over the past few decades. Facial behavior varies with a person's emotion according to differences in terms of culture, personality, age, context, and environment. In recent years, physiological activities have been used to study emotional responses. A typical signal is the electroencephalogram (EEG), which measures brain activity. Most of existing EEG-based emotion analysis has overlooked the role of facial expression changes. There exits little research on the relationship between facial behavior and brain signals due to the lack of dataset measuring both EEG and facial action signals simultaneously. To address this problem, we propose to develop a new database by collecting facial expressions, action units, and EEGs simultaneously. We recorded the EEGs and face videos of both posed facial actions and spontaneous expressions from 29 participants with different ages, genders, ethnic backgrounds. Differing from existing approaches, we designed a protocol to capture the EEG signals by evoking participants' individual action units explicitly. We also investigated the relation between the EEG signals and facial action units. As a baseline, the database has been evaluated through the experiments on both posed and spontaneous emotion recognition with images alone, EEG alone, and EEG fused with images, respectively. The database will be released to the research community to advance the state of the art for automatic emotion recognition.


title: Holographic reconstruction of asymptotically flat spacetimes

abstract: We present a "holographic" reconstruction of bulk spacetime geometry using correlation functions of a massless field living at the "future boundary" of the spacetime, namely future null infinity $\mathscr{I}^+$. It is holographic in the sense that there exists a one-to-one correspondence between correlation functions of a massless field in four-dimensional spacetime $\mathcal{M}$ and those of another massless field living in three-dimensional null boundary $\mathscr{I}^+$. The idea is to first reconstruct the bulk metric $g_{\mu\nu}$ by "inverting" the bulk correlation functions and re-express the latter in terms of boundary correlators via the correspondence. This effectively allows asymptotic observers close to $\mathscr{I}^+$ to reconstruct the deep interior of the spacetime using only correlation functions localized near $\mathscr{I}^+$.


title: The electronic structure of $\beta$-HgS via $GW$ calculations

abstract: The electronic structure of the zincblende $\beta$-HgS is not well understood. Previous first-principles calculations using fully-relativistic density functional theory and many-body perturbation theory in the fully-relativistic $GW$ approach have predicted an inverted, topologically non-trivial ordering of these states, with the $s$-like $\Gamma_6$ state occupied. However, other calculations using the $GW$ approach in which spin-orbit coupling is added perturbatively ("$GW$+SOC") predict the $p$-$d$ hybridized $\Gamma_7$ and $\Gamma_8$ states to be occupied and the $\Gamma_6$ state to be unoccupied, suggesting that $\beta$-HgS is a topologically trivial small band gap semiconductor. In the present work, a plane-wave pseudopotential fully-relativistic $GW$ calculation finds a band ordering in agreement with the previous $GW$+SOC calculations. The calculated band gap is 0.10 eV and the electron effective mass is 0.07 $m_e$, in good agreement with experiment.


title: Computational Complexity in Analogue Gravity

abstract: Analogue gravity helps to find some gravitational systems which are similar to the evolution of perturbation in condensed matter systems. These analogies provide a very good tool for either side. In other words, some aspects of gravity could be simulated in condensed matter laboratories. In this study, we are going to find an interpretation for computational complexity in condensed matter systems and the analogue of the uncertainty principle as the Lloyd bound. We show that this inequality roughly is equivalent to the KSS bound in the fluid/gravity duality and provides some experimental criteria to test the Lloyd bound in the laboratory.


title: Seq-2-Seq based Refinement of ASR Output for Spoken Name Capture

abstract: Person name capture from human speech is a difficult task in human-machine conversations. In this paper, we propose a novel approach to capture the person names from the caller utterances in response to the prompt "say and spell your first/last name". Inspired from work on spell correction, disfluency removal and text normalization, we propose a lightweight Seq-2-Seq system which generates a name spell from a varying user input. Our proposed method outperforms the strong baseline which is based on LM-driven rule-based approach.


title: Collaborative Learning and Patterns of Practice

abstract: In this article, an overview of the background, the research approaches and the patterns of practice in the field of collaborative learning are provided. A definition of collaborative learning and an overview of fundamental aspects that shape research and practice in this field are included. Pedagogies and learning theories that are used as foundations of the field alongside goals and objectives of collaborative learning approaches are discussed. Popular patterns of practice, exploring their application in classrooms and elaborating on the state of the art around those practices in research are outlined. A discussion about important topics, open questions and future directions are provided in conclusion.


title: ACR Loss: Adaptive Coordinate-based Regression Loss for Face Alignment

abstract: Although deep neural networks have achieved reasonable accuracy in solving face alignment, it is still a challenging task, specifically when we deal with facial images, under occlusion, or extreme head poses. Heatmap-based Regression (HBR) and Coordinate-based Regression (CBR) are among the two mainly used methods for face alignment. CBR methods require less computer memory, though their performance is less than HBR methods. In this paper, we propose an Adaptive Coordinate-based Regression (ACR) loss to improve the accuracy of CBR for face alignment. Inspired by the Active Shape Model (ASM), we generate Smooth-Face objects, a set of facial landmark points with less variations compared to the ground truth landmark points. We then introduce a method to estimate the level of difficulty in predicting each landmark point for the network by comparing the distribution of the ground truth landmark points and the corresponding Smooth-Face objects. Our proposed ACR Loss can adaptively modify its curvature and the influence of the loss based on the difficulty level of predicting each landmark point in a face. Accordingly, the ACR Loss guides the network toward challenging points than easier points, which improves the accuracy of the face alignment task. Our extensive evaluation shows the capabilities of the proposed ACR Loss in predicting facial landmark points in various facial images.


title: VPTR: Efficient Transformers for Video Prediction

abstract: In this paper, we propose a new Transformer block for video future frames prediction based on an efficient local spatial-temporal separation attention mechanism. Based on this new Transformer block, a fully autoregressive video future frames prediction Transformer is proposed. In addition, a non-autoregressive video prediction Transformer is also proposed to increase the inference speed and reduce the accumulated inference errors of its autoregressive counterpart. In order to avoid the prediction of very similar future frames, a contrastive feature loss is applied to maximize the mutual information between predicted and ground-truth future frame features. This work is the first that makes a formal comparison of the two types of attention-based video future frames prediction models over different scenarios. The proposed models reach a performance competitive with more complex state-of-the-art models. The source code is available at \emph{https://github.com/XiYe20/VPTR}.


title: Learning to Collide: Recommendation System Model Compression with Learned Hash Functions

abstract: A key characteristic of deep recommendation models is the immense memory requirements of their embedding tables. These embedding tables can often reach hundreds of gigabytes which increases hardware requirements and training cost. A common technique to reduce model size is to hash all of the categorical variable identifiers (ids) into a smaller space. This hashing reduces the number of unique representations that must be stored in the embedding table; thus decreasing its size. However, this approach introduces collisions between semantically dissimilar ids that degrade model quality. We introduce an alternative approach, Learned Hash Functions, which instead learns a new mapping function that encourages collisions between semantically similar ids. We derive this learned mapping from historical data and embedding access patterns. We experiment with this technique on a production model and find that a mapping informed by the combination of access frequency and a learned low dimension embedding is the most effective. We demonstrate a small improvement relative to the hashing trick and other collision related compression techniques. This is ongoing work that explores the impact of categorical id collisions on recommendation model quality and how those collisions may be controlled to improve model performance.


title: Late-time asymptotics for geometric wave equations with inverse-square potentials

abstract: We introduce a new, physical-space-based method for deriving the precise leading-order late-time behaviour of solutions to geometric wave equations on asymptotically flat spacetime backgrounds and apply it to the setting of wave equations with asymptotically inverse-square potentials on Schwarzschild black holes. This provides a useful toy model setting for introducing methods that are applicable to more general linear and nonlinear geometric wave equations, such as wave equations for electromagnetically charged scalar fields, wave equations on extremal Kerr black holes and geometric wave equations in even space dimensions, where existing proofs for deriving precise late-time asymptotics might not apply. The method we introduce relies on exploiting the spatial decay properties of time integrals of solutions to derive the existence and precise genericity properties of asymptotic late-time tails and obtain sharp, uniform decay estimates in time.


title: Quantum Annealing and Computation

abstract: We introduce and review briefly the phenomenon of quantum annealing and analog computation. The role of quantum fluctuation (tunneling) in random systems with rugged (free) energy landscapes having macroscopic barriers are discussed to demonstrate the quantum advantage in the search for the ground state(s) through annealing. Quantum annealing as a physical (analog) process to search for the optimal solutions of computationally hard problems are also discussed.


title: Autoregressive Co-Training for Learning Discrete Speech Representations

abstract: While several self-supervised approaches for learning discrete speech representation have been proposed, it is unclear how these seemingly similar approaches relate to each other. In this paper, we consider a generative model with discrete latent variables that learns a discrete representation for speech. The objective of learning the generative model is formulated as information-theoretic co-training. Besides the wide generality, the objective can be optimized with several approaches, subsuming HuBERT-like training and vector quantization for learning discrete representation. Empirically, we find that the proposed approach learns discrete representation that is highly correlated with phonetic units, more correlated than HuBERT-like training and vector quantization.


title: NNLander-VeriF: A Neural Network Formal Verification Framework for Vision-Based Autonomous Aircraft Landing

abstract: In this paper, we consider the problem of formally verifying a Neural Network (NN) based autonomous landing system. In such a system, a NN controller processes images from a camera to guide the aircraft while approaching the runway. A central challenge for the safety and liveness verification of vision-based closed-loop systems is the lack of mathematical models that captures the relation between the system states (e.g., position of the aircraft) and the images processed by the vision-based NN controller. Another challenge is the limited abilities of state-of-the-art NN model checkers. Such model checkers can reason only about simple input-output robustness properties of neural networks. This limitation creates a gap between the NN model checker abilities and the need to verify a closed-loop system while considering the aircraft dynamics, the perception components, and the NN controller. To this end, this paper presents NNLander-VeriF, a framework to verify vision-based NN controllers used for autonomous landing. NNLander-VeriF addresses the challenges above by exploiting geometric models of perspective cameras to obtain a mathematical model that captures the relation between the aircraft states and the inputs to the NN controller. By converting this model into a NN (with manually assigned weights) and composing it with the NN controller, one can capture the relation between aircraft states and control actions using one augmented NN. Such an augmented NN model leads to a natural encoding of the closed-loop verification into several NN robustness queries, which state-of-the-art NN model checkers can handle. Finally, we evaluate our framework to formally verify the properties of a trained NN and we show its efficiency.


title: Ab initio electronic stationary states for nuclear projectiles in solids

abstract: The process by which a nuclear projectile is decelerated by the electrons of the condensed matter it traverses is currently being studied by following the explicit dynamics of projectile and electrons from first principles in a simulation box with a sample of the host matter in periodic boundary conditions. The approach has been quite successful for diverse systems even in the strong-coupling regime of maximal dissipation. This technique is here revisited for periodic solids in the light of the Floquet theory of stopping, a time-periodic scattering framework characterizing the stationary dynamicalsolutions for a constant velocity projectile in an infinite solid. The effect of proton projectiles in diamond is studied under that light, using time-dependent density-functional theory in real time. The Floquet quasi-energy conserving stationary scattering regime, characterized by time-periodic properties such as particle density and the time derivative of energy, is obtained for a converged system size of one thousand atoms. The validity of the customary calculation of electronic stopping power from the average slope of the density-functional total energy is discussed. Quasi-energy conservation, as well as the implied fundamental approximations, are critically reviewed.


title: Uniqueness for the Nonlocal Liouville Equation in $\mathbb{R}$

abstract: We prove uniqueness of solutions for the nonlocal Liouville equation $$ (-\Delta)^{1/2} w = K e^w \quad \mbox{in $\mathbb{R}$} $$ with finite total $Q$-curvature $\int_{\mathbb{R}} K e^w \, dx< +\infty$. Here the prescribed $Q$-curvature function $K=K(|x|) > 0$ is assumed to be a positive, symmetric-decreasing function satisfying suitable regularity and decay bounds. In particular, we obtain uniqueness of solutions in the Gaussian case with $K(x) = \exp(-x^2)$. Our uniqueness proof exploits a connection of the nonlocal Liouville equation to ground state solitons for Calogero--Moser derivative NLS, which is a completely integrable PDE recently studied by P. G\'erard and the second author.


title: The micromagnetic energy with Dzyaloshinskii-Moriya interaction in a thin-film regime relevant for boundary vortices

abstract: We consider the three-dimensional micromagnetic model with Dzyaloshinskii-Moriya interaction in a thin-film regime. We prove the Gamma-convergence of the micromagnetic energy in the considered regime, for which the Gamma-limit energy is two-dimensional and relevant for boundary vortices. We then study local minimizers of the Gamma-limit energy and prove a uniqueness result in a certain setting.


title: Topological Experience Replay

abstract: State-of-the-art deep Q-learning methods update Q-values using state transition tuples sampled from the experience replay buffer. This strategy often uniformly and randomly samples or prioritizes data sampling based on measures such as the temporal difference (TD) error. Such sampling strategies can be inefficient at learning Q-function because a state's Q-value depends on the Q-value of successor states. If the data sampling strategy ignores the precision of the Q-value estimate of the next state, it can lead to useless and often incorrect updates to the Q-values. To mitigate this issue, we organize the agent's experience into a graph that explicitly tracks the dependency between Q-values of states. Each edge in the graph represents a transition between two states by executing a single action. We perform value backups via a breadth-first search starting from that expands vertices in the graph starting from the set of terminal states and successively moving backward. We empirically show that our method is substantially more data-efficient than several baselines on a diverse range of goal-reaching tasks. Notably, the proposed method also outperforms baselines that consume more batches of training experience and operates from high-dimensional observational data such as images.


title: Characterization and Verification of Trotterized Digital Quantum Simulation via Hamiltonian and Liouvillian Learning

abstract: The goal of digital quantum simulation is to approximate the dynamics of a given target Hamiltonian via a sequence of quantum gates, a procedure known as Trotterization. The quality of this approximation can be controlled by the so called Trotter step, that governs the number of required quantum gates per unit simulation time. The stroboscopic dynamics generated by Trotterization is effectively described by a time-independent Hamiltonian, referred to as the Floquet Hamiltonian. In this work, we propose Floquet Hamiltonian learning to reconstruct the experimentally realized Floquet Hamiltonian order-by-order in the Trotter step. This procedure is efficient, i.e., it requires a number of measurements that scales polynomially in the system size, and can be readily implemented in state-of-the-art experiments. With numerical examples, we propose several applications of our method in the context of verification of quantum devices: from the characterization of the distinct sources of errors in digital quantum simulators to determining the optimal operating regime of the device. We show that our protocol provides the basis for feedback-loop design and calibration of new types of quantum gates. Furthermore it can be extended to the case of non-unitary dynamics and used to learn Floquet Liouvillians, thereby offering a way of characterizing the dissipative processes present in NISQ quantum devices.


title: From ten-flavor tests of the $\beta$-function to $\alpha_s$ at the Z-pole

abstract: New tests are applied to two $\beta$-functions of the much-discussed BSM model with ten massless fermion flavors in the fundamental representation of the SU(3) color gauge group. The renormalization scheme of the two $\beta$-functions is defined on the gauge field gradient flow in respective finite or infinite physical volumes at zero lattice spacing. Recently published results in the ten-flavor theory led to indicators of an infrared fixed point (IRFP) in the finite-volume step $\beta$-function in the strong coupling regime of the theory arXiv:2004.00754. We analyze our substantially extended set of ten-flavor lattice ensembles at strong renormalized gauge couplings and find no evidence or hint for IRFP in the finite-volume step $\beta$-function within controlled lattice reach. We also discuss new ten-flavor tests of the recently introduced lattice definition and algorithmic implementation of the $\beta$-function defined on the gradient flow of the gauge field over infinite Euclidean space-time in the continuum. Originally we introduced this new algorithm to match finite-volume step $\beta$-functions in massless near-conformal gauge theories with the infinite-volume $\beta$-function reached in the chiral limit from small fermion mass deformations of spontaneous chiral symmetry breaking. Results from the lattice analysis of the ten-flavor infinite-volume $\beta$-function are consistent with the absence of IRFP from our step $\beta$-function based analysis. We make important contact at weak coupling in infinite volume with gradient flow based three-loop perturbation theory, serving as a first pilot study toward the long-term goal of developing alternate approach to the determination of the strong coupling $\alpha_s$ at the Z-boson pole in QCD.


title: An extended range of energy stable flux reconstruction methods on triangles

abstract: We present an extended range of stable flux reconstruction (FR) methods on triangles through the development and application of the summation-by-parts framework in two-dimensions. This extended range of stable schemes is then shown to contain the single parameter schemes of \citet{Castonguay2011} on triangles, and our definition enables wider stability bounds to be developed for those single parameter families. Stable upwinded spectral difference (SD) schemes on triangular elements have previously been found using Fourier analysis. We used our extended range of FR schemes to investigate the linear stability of SD methods on triangles, and it was found that a only first order SD scheme could be recovered within this set of FR methods.


title: When Bousfield localizations and homotopy idempotent functors meet again

abstract: We adopt semimodel categories to extend fundamental results related to Bousfield localizations of model categories. More specifically, we generalize Bousfield-Friedlander Theorem and Hirschhorn Localization Theorem of cellular model categories to settings where their classical formulation does not apply. We use such results to answer, in the world of semimodel categories, an open problem posed by May-Ponto about the existence of Bousfield localizations for Hurewicz and mixed type model structures.


title: Fault Detection and Isolation of Uncertain Nonlinear Parabolic PDE Systems

abstract: This paper proposes a novel fault detection and isolation (FDI) scheme for distributed parameter systems modeled by a class of parabolic partial differential equations (PDEs) with nonlinear uncertain dynamics. A key feature of the proposed FDI scheme is its capability of dealing with the effects of system uncertainties for accurate FDI. Specifically, an approximate ordinary differential equation (ODE) system is first derived to capture the dominant dynamics of the original PDE system. An adaptive dynamics identification approach using radial basis function neural network is then proposed based on this ODE system, so as to achieve locally-accurate identification of the uncertain system dynamics under normal and faulty modes. A bank of FDI estimators with associated adaptive thresholds are finally designed for real-time FDI decision making. Rigorous analysis on the FDI performance in terms of fault detectability and isolatability is provided. Simulation study on a representative transport-reaction process is conducted to demonstrate the effectiveness and advantage of the proposed approach.


title: Neural Inertial Localization

abstract: This paper proposes the inertial localization problem, the task of estimating the absolute location from a sequence of inertial sensor measurements. This is an exciting and unexplored area of indoor localization research, where we present a rich dataset with 53 hours of inertial sensor data and the associated ground truth locations. We developed a solution, dubbed neural inertial localization (NILoc) which 1) uses a neural inertial navigation technique to turn inertial sensor history to a sequence of velocity vectors; then 2) employs a transformer-based neural architecture to find the device location from the sequence of velocities. We only use an IMU sensor, which is energy efficient and privacy preserving compared to WiFi, cameras, and other data sources. Our approach is significantly faster and achieves competitive results even compared with state-of-the-art methods that require a floorplan and run 20 to 30 times slower. We share our code, model and data at https://sachini.github.io/niloc.


title: Direct Sampling with a Step Function

abstract: The direct sampling method proposed by Walker et al. (JCGS 2011) can generate draws from weighted distributions possibly having intractable normalizing constants. The method may be of interest as a useful tool in situations which require drawing from an unfamiliar distribution. However, the original algorithm can have difficulty producing draws in some situations. The present work restricts attention to a univariate setting where the weight function and base distribution of the weighted target density meet certain criteria. Here, a variant of the direct sampler is proposed which uses a step function to approximate the density of a particular augmented random variable on which the method is based. Knots for the step function can be placed strategically to ensure the approximation is close to the underlying density. Variates may then be generated reliably while largely avoiding the need for manual tuning or rejections. A rejection sampler based on the step function allows exact draws to be generated from the target with lower rejection probability in exchange for increased computation. Several applications of the proposed sampler illustrate the method: generating draws from the Conway-Maxwell Poisson distribution, a Gibbs sampler which draws the dependence parameter in a random effects model with conditional autoregression structure, and a Gibbs sampler which draws the degrees-of-freedom parameter in a regression with t-distributed errors.


title: Near-optimality for infinite-horizon restless bandits with many arms

abstract: Restless bandits are an important class of problems with applications in recommender systems, active learning, revenue management and other areas. We consider infinite-horizon discounted restless bandits with many arms where a fixed proportion of arms may be pulled in each period and where arms share a finite state space. Although an average-case-optimal policy can be computed via stochastic dynamic programming, the computation required grows exponentially with the number of arms $N$. Thus, it is important to find scalable policies that can be computed efficiently for large $N$ and that are near optimal in this regime, in the sense that the optimality gap (i.e. the loss of expected performance against an optimal policy) per arm vanishes for large $N$. However, the most popular approach, the Whittle index, requires a hard-to-verify indexability condition to be well-defined and another hard-to-verify condition to guarantee a $o(N)$ optimality gap. We present a method resolving these difficulties. By replacing a global Lagrange multiplier used by the Whittle index with a sequence of Lagrangian multipliers, one per time period up to a finite truncation point, we derive a class of policies, called fluid-balance policies, that have a $O(\sqrt{N})$ optimality gap. Unlike the Whittle index, fluid-balance policies do not require indexability to be well-defined and their $O(\sqrt{N})$ optimality gap bound holds universally without sufficient conditions. We also demonstrate empirically that fluid-balance policies provide state-of-the-art performance on specific problems.


title: Locomotion Policy Guided Traversability Learning using Volumetric Representations of Complex Environments

abstract: Despite the progress in legged robotic locomotion, autonomous navigation in unknown environments remains an open problem. Ideally, the navigation system utilizes the full potential of the robots' locomotion capabilities while operating within safety limits under uncertainty. The robot must sense and analyze the traversability of the surrounding terrain, which depends on the hardware, locomotion control, and terrain properties. It may contain information about the risk, energy, or time consumption needed to traverse the terrain. To avoid hand-crafted traversability cost functions we propose to collect traversability information about the robot and locomotion policy by simulating the traversal over randomly generated terrains using a physics simulator. Thousand of robots are simulated in parallel controlled by the same locomotion policy used in reality to acquire 57 years of real-world locomotion experience equivalent. For deployment on the real robot, a sparse convolutional network is trained to predict the simulated traversability cost, which is tailored to the deployed locomotion policy, from an entirely geometric representation of the environment in the form of a 3D voxel-occupancy map. This representation avoids the need for commonly used elevation maps, which are error-prone in the presence of overhanging obstacles and multi-floor or low-ceiling scenarios. The effectiveness of the proposed traversability prediction network is demonstrated for path planning for the legged robot ANYmal in various indoor and natural environments.


title: Supercycles, stable supermaps and SUSY Nori motives

abstract: We define stable supercurves and stable supermaps, and based on these notions we develop a theory of Nori motives for the category of stable supermaps of SUSY curves with punctures. This will require several preliminary constructions, including the development of a basic theory of supercycles.


title: OdontoAI: A human-in-the-loop labeled data set and an online platform to boost research on dental panoramic radiographs

abstract: Deep learning has remarkably advanced in the last few years, supported by large labeled data sets. These data sets are precious yet scarce because of the time-consuming labeling procedures, discouraging researchers from producing them. This scarcity is especially true in dentistry, where deep learning applications are still in an embryonic stage. Motivated by this background, we address in this study the construction of a public data set of dental panoramic radiographs. Our objects of interest are the teeth, which are segmented and numbered, as they are the primary targets for dentists when screening a panoramic radiograph. We benefited from the human-in-the-loop (HITL) concept to expedite the labeling procedure, using predictions from deep neural networks as provisional labels, later verified by human annotators. All the gathering and labeling procedures of this novel data set is thoroughly analyzed. The results were consistent and behaved as expected: At each HITL iteration, the model predictions improved. Our results demonstrated a 51% labeling time reduction using HITL, saving us more than 390 continuous working hours. In a novel online platform, called OdontoAI, created to work as task central for this novel data set, we released 4,000 images, from which 2,000 have their labels publicly available for model fitting. The labels of the other 2,000 images are private and used for model evaluation considering instance and semantic segmentation and numbering. To the best of our knowledge, this is the largest-scale publicly available data set for panoramic radiographs, and the OdontoAI is the first platform of its kind in dentistry.


title: Acquiring elastic properties of thin composite structure from vibrational testing data

abstract: The problem of acquiring elastic properties of a composite material from the data of the vibrational testing is considered. The specimen is considered to abide by the linear elasticity laws and subject to viscoelastic damping. The BVP for transverse movement of such a specimen under harmonic load is formulated and solved with finite-element method. The problem of acquiring the elastic parameters is then formulated as a nonlinear least square optimization problem. The usage of the automatic differentiation technique for stable and efficient computation of the gradient and hessian allows to use well-studied first and second order optimization methods, namely Newton and BFGS. The results of the numerical experiments on simulated data are analyzed in order to provide insights for the experiment planning.


title: Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics

abstract: Current practices in metric evaluation focus on one single dataset, e.g., Newstest dataset in each year's WMT Metrics Shared Task. However, in this paper, we qualitatively and quantitatively show that the performances of metrics are sensitive to data. The ranking of metrics varies when the evaluation is conducted on different datasets. Then this paper further investigates two potential hypotheses, i.e., insignificant data points and the deviation of Independent and Identically Distributed (i.i.d) assumption, which may take responsibility for the issue of data variance. In conclusion, our findings suggest that when evaluating automatic translation metrics, researchers should take data variance into account and be cautious to claim the result on a single dataset, because it may leads to inconsistent results with most of other datasets.


title: NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Models

abstract: Neural image caption generation (NICG) models have received massive attention from the research community due to their excellent performance in visual understanding. Existing work focuses on improving NICG model accuracy while efficiency is less explored. However, many real-world applications require real-time feedback, which highly relies on the efficiency of NICG models. Recent research observed that the efficiency of NICG models could vary for different inputs. This observation brings in a new attack surface of NICG models, i.e., An adversary might be able to slightly change inputs to cause the NICG models to consume more computational resources. To further understand such efficiency-oriented threats, we propose a new attack approach, NICGSlowDown, to evaluate the efficiency robustness of NICG models. Our experimental results show that NICGSlowDown can generate images with human-unnoticeable perturbations that will increase the NICG model latency up to 483.86%. We hope this research could raise the community's concern about the efficiency robustness of NICG models.


title: Visualizing the Relationship Between Encoded Linguistic Information and Task Performance

abstract: Probing is popular to analyze whether linguistic information can be captured by a well-trained deep neural model, but it is hard to answer how the change of the encoded linguistic information will affect task performance. To this end, we study the dynamic relationship between the encoded linguistic information and task performance from the viewpoint of Pareto Optimality. Its key idea is to obtain a set of models which are Pareto-optimal in terms of both objectives. From this viewpoint, we propose a method to optimize the Pareto-optimal models by formalizing it as a multi-objective optimization problem. We conduct experiments on two popular NLP tasks, i.e., machine translation and language modeling, and investigate the relationship between several kinds of linguistic information and task performances. Experimental results demonstrate that the proposed method is better than a baseline method. Our empirical findings suggest that some syntactic information is helpful for NLP tasks whereas encoding more syntactic information does not necessarily lead to better performance, because the model architecture is also an important factor.


title: Non-Lie subgroups in Lie groups over local fields of positive characteristic

abstract: By Cartan's Theorem, every closed subgroup $H$ of a real (or $p$-adic) Lie group $G$ is a Lie subgroup. For Lie groups over a local field ${\mathbb K}$ of positive characteristic, the analogous conclusion is known to be wrong. We show more: There exists a ${\mathbb K}$-analytic Lie group $G$ and a non-discrete, compact subgroup $H$ such that, for every ${\mathbb K}$-analytic manifold $M$, every ${\mathbb K}$-analytic map $f\colon M\to G$ with $f(M)\subseteq H$ is locally constant. In particular, the set $H$ does not admit a non-discrete ${\mathbb K}$-analytic manifold structure which makes the inclusion of $H$ into $G$ a ${\mathbb K}$-analytic map. We can achieve that, moreover, $H$ does not admit a ${\mathbb K}$-analytic Lie group structure compatible with the topological group structure induced by $G$ on $H$.


title: Restless Temporal Path Parameterized Above Lower Bounds

abstract: Reachability questions are one of the most fundamental algorithmic primitives in temporal graphs -- graphs whose edge set changes over discrete time steps. A core problem here is the NP-hard Short Restless Temporal Path: given a temporal graph $\mathcal G$, two distinct vertices $s$ and $z$, and two numbers $\delta$ and $k$, is there a $\delta$-restless temporal $s$-$z$ path of length at most $k$? A temporal path is a path whose edges appear in chronological order and a temporal path is $\delta$-restless if two consecutive path edges appear at most $\delta$ time steps apart from each other. Among others, this problem has applications in neuroscience and epidemiology. While Short Restless Temporal Path is known to be computationally hard, e.g., it is NP-hard for only three time steps and W[1]-hard when parameterized by the feedback vertex number of the underlying graph, it is fixed-parameter tractable when parameterized by the path length $k$. We improve on this by showing that Short Restless Temporal Path can be solved in (randomized) $4^{k-d}|\mathcal G|^{O(1)}$ time, where $d$ is the minimum length of a temporal $s$-$z$ path.


title: WAVPROMPT: Towards Few-Shot Spoken Language Understanding with Frozen Language Models

abstract: Large-scale auto-regressive language models pretrained on massive text have demonstrated their impressive ability to perform new natural language tasks with only a few text examples, without the need for fine-tuning. Recent studies further show that such a few-shot learning ability can be extended to the text-image setting by training an encoder to encode the images into embeddings functioning like the text embeddings of the language model. Interested in exploring the possibility of transferring the few-shot learning ability to the audio-text setting, we propose a novel speech understanding framework, WavPrompt, where we finetune a wav2vec model to generate a sequence of audio embeddings understood by the language model. We show that WavPrompt is a few-shot learner that can perform speech understanding tasks better than a naive text baseline. We conduct detailed ablation studies on different components and hyperparameters to empirically identify the best model configuration. In addition, we conduct a non-speech understanding experiment to show WavPrompt can extract more information than just the transcriptions. Code is available at https://github.com/Hertin/WavPrompt


title: Measurement of software development effort estimation bias: Avoiding biased measures of estimation bias

abstract: In this paper, we propose improvements in how estimation bias, e.g., the tendency towards under-estimating the effort, is measured. The proposed approach emphasizes the need to know what the estimates are meant to represent, i.e., the type of estimate we evaluate and the need for a match between the type of estimate given and the bias measure used. We show that even perfect estimates of the mean effort will not lead to an expectation of zero estimation bias when applying the frequently used bias measure: (actual effort - estimated effort)/actual effort. This measure will instead reward under-estimates of the mean effort. We also provide examples of bias measures that match estimates of the mean and the median effort, and argue that there are, in general, no practical bias measures for estimates of the most likely effort. The paper concludes with implications for the evaluation of bias of software development effort estimates.


title: On Triangulation as a Form of Self-Supervision for 3D Human Pose Estimation

abstract: Supervised approaches to 3D pose estimation from single images are remarkably effective when labeled data is abundant. However, as the acquisition of ground-truth 3D labels is labor intensive and time consuming, recent attention has shifted towards semi- and weakly-supervised learning. Generating an effective form of supervision with little annotations still poses major challenge in crowded scenes. In this paper we propose to impose multi-view geometrical constraints by means of a weighted differentiable triangulation and use it as a form of self-supervision when no labels are available. We therefore train a 2D pose estimator in such a way that its predictions correspond to the re-projection of the triangulated 3D pose and train an auxiliary network on them to produce the final 3D poses. We complement the triangulation with a weighting mechanism that alleviates the impact of noisy predictions caused by self-occlusion or occlusion from other subjects. We demonstrate the effectiveness of our semi-supervised approach on Human3.6M and MPI-INF-3DHP datasets, as well as on a new multi-view multi-person dataset that features occlusion.


title: Indoor SLAM Using a Foot-mounted IMU and the local Magnetic Field

abstract: In this paper, a simultaneous localization and mapping (SLAM) algorithm for tracking the motion of a pedestrian with a foot-mounted inertial measurement unit (IMU) is proposed. The algorithm uses two maps, namely, a motion map and a magnetic field map. The motion map captures typical motion patterns of pedestrians in buildings that are constrained by e.g. corridors and doors. The magnetic map models local magnetic field anomalies in the environment using a Gaussian process (GP) model and uses them as position information. These maps are used in a Rao-Blackwellized particle filter (RBPF) to correct the pedestrian position and orientation estimates from the pedestrian dead-reckoning (PDR). The PDR is computed using an extended Kalman filter with zero-velocity updates (ZUPT-EKF). The algorithm is validated using real experimental sequences and the results show the efficacy of the algorithm in localizing pedestrians in indoor environments.


abstract: The ability to integrate context, including perceptual and temporal cues, plays a pivotal role in grounding the meaning of a linguistic utterance. In order to measure to what extent current vision-and-language models master this ability, we devise a new multimodal challenge, Image Retrieval from Contextual Descriptions (ImageCoDe). In particular, models are tasked with retrieving the correct image from a set of 10 minimally contrastive candidates based on a contextual description. As such, each description contains only the details that help distinguish between images. Because of this, descriptions tend to be complex in terms of syntax and discourse and require drawing pragmatic inferences. Images are sourced from both static pictures and video frames. We benchmark several state-of-the-art models, including both cross-encoders such as ViLBERT and bi-encoders such as CLIP, on ImageCoDe. Our results reveal that these models dramatically lag behind human performance: the best variant achieves an accuracy of 20.9 on video frames and 59.4 on static pictures, compared with 90.8 in humans. Furthermore, we experiment with new model variants that are better equipped to incorporate visual and temporal context into their representations, which achieve modest gains. Our hope is that ImageCoDE will foster progress in grounded language understanding by encouraging models to focus on fine-grained visual differences.