title: Court Judgement Labeling Using Topic Modeling and Syntactic Parsing

abstract: In regions that practice common law, relevant historical cases are essential references for sentencing. To help legal practitioners find previous judgement easier, this paper aims to label each court judgement by some tags. These tags are legally important to summarize the judgement and can guide the user to similar judgements. We introduce a heuristic system to solve the problem, which starts from Aspect-driven Topic Modeling and uses Dependency Parsing and Constituency Parsing for phrase generation. We also construct a legal term tree for Hong Kong and implemented a sentence simplification module to support the system. Finally, we propose a similar document recommendation algorithm based on the generated tags. It enables users to find similar documents based on a few selected aspects rather than the whole passage. Experiment results show that this system is the best approach for this specific task. It is better than simple term extraction method in terms of summarizing the document, and the recommendation algorithm is more effective than full-text comparison approaches. We believe that the system has huge potential in law as well as in other areas.


title: SKDCGN: Source-free Knowledge Distillation of Counterfactual Generative Networks using cGANs

abstract: With the usage of appropriate inductive biases, Counterfactual Generative Networks (CGNs) can generate novel images from random combinations of shape, texture, and background manifolds. These images can be utilized to train an invariant classifier, avoiding the wide spread problem of deep architectures learning spurious correlations rather than meaningful ones. As a consequence, out-of-domain robustness is improved. However, the CGN architecture comprises multiple over parameterized networks, namely BigGAN and U2-Net. Training these networks requires appropriate background knowledge and extensive computation. Since one does not always have access to the precise training details, nor do they always possess the necessary knowledge of counterfactuals, our work addresses the following question: Can we use the knowledge embedded in pre-trained CGNs to train a lower-capacity model, assuming black-box access (i.e., only access to the pretrained CGN model) to the components of the architecture? In this direction, we propose a novel work named SKDCGN that attempts knowledge transfer using Knowledge Distillation (KD). In our proposed architecture, each independent mechanism (shape, texture, background) is represented by a student 'TinyGAN' that learns from the pretrained teacher 'BigGAN'. We demonstrate the efficacy of the proposed method using state-of-the-art datasets such as ImageNet, and MNIST by using KD and appropriate loss functions. Moreover, as an additional contribution, our paper conducts a thorough study on the composition mechanism of the CGNs, to gain a better understanding of how each mechanism influences the classification accuracy of an invariant classifier. Code available at: https://github.com/ambekarsameer96/SKDCGN


title: A Multi-label Continual Learning Framework to Scale Deep Learning Approaches for Packaging Equipment Monitoring

abstract: Continual Learning aims to learn from a stream of tasks, being able to remember at the same time both new and old tasks. While many approaches were proposed for single-class classification, multi-label classification in the continual scenario remains a challenging problem. For the first time, we study multi-label classification in the Domain Incremental Learning scenario. Moreover, we propose an efficient approach that has a logarithmic complexity with regard to the number of tasks, and can be applied also in the Class Incremental Learning scenario. We validate our approach on a real-world multi-label Alarm Forecasting problem from the packaging industry. For the sake of reproducibility, the dataset and the code used for the experiments are publicly available.


title: Compact Hausdorff Locales in presheaf toposes

abstract: We prove that for any small category $\mathcal{C}$, the category $\mathbf{KHausLoc}_{\hat{\mathcal{C}}}$ of compact Hausdorff locales in the presheaf topos $\hat{\mathcal{C}}$, is equivalent to the category of functors $\mathcal{C} \to \mathbf{KHausLoc}$.


title: Choose, not Hoard: Information-to-Model Matching for Artificial Intelligence in O-RAN

abstract: Open Radio Access Network (O-RAN) is an emerging paradigm, whereby virtualized network infrastructure elements from different vendors communicate via open, standardized interfaces. A key element therein is the RAN Intelligent Controller (RIC), an Artificial Intelligence (AI)-based controller. Traditionally, all data available in the network has been used to train a single AI model to be used at the RIC. This paper introduces, discusses, and evaluates the creation of multiple AI model instances at different RICs, leveraging information from some (or all) locations for their training. This brings about a flexible relationship between gNBs, the AI models used to control them, and the data such models are trained with. Experiments with real-world traces show how using multiple AI model instances that choose training data from specific locations improve the performance of traditional approaches following the hoarding strategy.


title: OGLE-2019-BLG-0362Lb: A super-Jovian-mass planet around a low-mass star

abstract: We present the analysis of a planetary microlensing event OGLE-2019-BLG-0362 with a short-duration anomaly $(\sim 0.4\, \rm days)$ near the peak of the light curve, which is caused by the resonant caustic. The event has a severe degeneracy with $\Delta \chi^2 = 0.9$ between the close and the wide binary lens models both with planet-host mass ratio $q \simeq 0.007$. We measure the angular Einstein radius but not the microlens parallax, and thus we perform a Bayesian analysis to estimate the physical parameters of the lens. We find that the OGLE-2019-BLG-0362L system is a super-Jovian-mass planet $M_{\rm p}=3.26^{+0.83}_{-0.58}\, M_{\rm J}$ orbiting an M dwarf $M_{\rm h}=0.42^{+0.34}_{-0.23}\, M_\odot$ at a distance $D_{\rm L} =5.83^{+1.04}_{-1.55}\, \rm kpc$. The projected star-planet separation is $a_{\perp} = 2.18^{+0.58}_{-0.72}\, \rm AU$, which indicates that the planet lies beyond the snow line of the host star.


title: ReSiPI: A Reconfigurable Silicon-Photonic 2.5D Chiplet Network with PCMs for Energy-Efficient Interposer Communication

abstract: 2.5D chiplet systems have been proposed to improve the low manufacturing yield of large-scale chips. However, connecting the chiplets through an electronic interposer imposes a high traffic load on the interposer network. Silicon photonics technology has shown great promise towards handling a high volume of traffic with low latency in intra-chip network-on-chip (NoC) fabrics. Although recent advances in silicon photonic devices have extended photonic NoCs to enable high bandwidth communication in 2.5D chiplet systems, such interposer-based photonic networks still suffer from high power consumption. In this work, we design and analyze a novel Reconfigurable power-efficient and congestion-aware Silicon Photonic 2.5D Interposer network, called ReSiPI. Considering run-time traffic, ReSiPI is able to dynamically deploy inter-chiplet photonic gateways to improve the overall network congestion. ReSiPI also employs switching elements based on phase change materials (PCMs) to dynamically reconfigure and power-gate the photonic interposer network, thereby improving the network power efficiency. Compared to the best prior state-of-the-art 2.5D photonic network, ReSiPI demonstrates, on average, 37% lower latency, 25% power reduction, and 53% energy minimization in the network.


title: Learning Diverse Document Representations with Deep Query Interactions for Dense Retrieval

abstract: In this paper, we propose a new dense retrieval model which learns diverse document representations with deep query interactions. Our model encodes each document with a set of generated pseudo-queries to get query-informed, multi-view document representations. It not only enjoys high inference efficiency like the vanilla dual-encoder models, but also enables deep query-document interactions in document encoding and provides multi-faceted representations to better match different queries. Experiments on several benchmarks demonstrate the effectiveness of the proposed method, out-performing strong dual encoder baselines.The code is available at \url{https://github.com/jordane95/dual-cross-encoder


title: Sampling, Communication, and Prediction Co-Design for Synchronizing the Real-World Device and Digital Model in Metaverse

abstract: The metaverse has the potential to revolutionize the next generation of the Internet by supporting highly interactive services with the help of Mixed Reality (MR) technologies; still, to provide a satisfactory experience for users, the synchronization between the physical world and its digital models is crucial. This work proposes a sampling, communication and prediction co-design framework to minimize the communication load subject to a constraint on tracking the Mean Squared Error (MSE) between a real-world device and its digital model in the metaverse. To optimize the sampling rate and the prediction horizon, we exploit expert knowledge and develop a constrained Deep Reinforcement Learning (DRL) algorithm, named Knowledge-assisted Constrained Twin-Delayed Deep Deterministic (KC-TD3) policy gradient algorithm. We validate our framework on a prototype composed of a real-world robotic arm and its digital model. Compared with existing approaches: (1) When the tracking error constraint is stringent (MSE=0.002 degrees), our policy degenerates into the policy in the sampling-communication co-design framework. (2) When the tracking error constraint is mild (MSE=0.007 degrees), our policy degenerates into the policy in the prediction-communication co-design framework. (3) Our framework achieves a better trade-off between the average MSE and the average communication load compared with a communication system without sampling and prediction. For example, the average communication load can be reduced up to 87% when the track error constraint is 0.002 degrees. (4) Our policy outperforms the benchmark with the static sampling rate and prediction horizon optimized by exhaustive search, in terms of the tail probability of the tracking error. Furthermore, with the assistance of expert knowledge, the proposed algorithm KC-TD3 achieves better convergence time, stability, and final policy performance.


title: Avoiding critical slowdown in models with SALR interactions

abstract: In systems with frustration, the critical slowdown of the dynamics severely impedes the numerical study of phase transitions for even the simplest of lattice models. In order to help sidestep the gelation-like sluggishness, a clearer understanding of the underlying physics is needed. Here, we first obtain generic insights into that phenomenon by studying one-dimensional and Bethe lattice versions of a schematic frustrated model, the axial next-nearest neighbor Ising (ANNNI) model. Based on these findings, we formulate two cluster algorithms that speed up the simulations of the ANNNI model on a 2D square lattice. Although these schemes do not avoid the critical slowdown, speed-ups of factors up to 40 are achieved in some regimes.


title: Informal proceedings of the 32nd International Symposium on Logic-Based Program Synthesis and Transformation (LOPSTR 2022)

abstract: This volume constitutes the informal proceedings of the 32nd International Symposium on Logic-Based Program Synthesis and Transformation (LOPSTR 2022), held on 21-23rd September 2022 as a hybrid (blended) meeting, both in-person (at the Ivane Javakhishvili Tbilisi State University -TSU- in Tbilisi, Georgia) and virtual, and co-located with the 24th International Symposium on Principles and Practice of Declarative Programming (PPDP 2022) as part of the Computational Logic Autumn Summit 2022 (CLAS 2022).


title: A Comparison Study of the Detection Limit of Omicron SARS-CoV-2 Nucleocapsid by various Rapid Antigen Tests

abstract: Since the first case of COVID-19 disease in Wuhan in December 2019, there is a worldwide struggle to reduce the transmission of acute respiratory syndrome coronavirus SARS-CoV-2. Many countries worldwide decided to impose local lockdowns in order to reduce person-to-person interactions, masks became obligatory especially in closed spaces, and there was a general requirement for social distance. However, the most efficient method to reduce continuing spreading of infection among the population, and in the meantime maintain a regular daily life, is early detection of infected contagious people. Up to now, the most reliable method for SARS-CoV-2 detection is reverse-transcriptase PCR test (RT-PCR). It is possible to detect the virus even if there is only one RNA strand in the sample, and run hundreds of samples simultaneously. This method has a few disadvantages, such as high cost, is time consuming, the need for medical laboratories and skilled staff to perform the test, and the major flaw: the lack of appropriate number of available tests. The latterly prominent Omicron variant (B.1.1.529) and its derivatives have caused a tremendous increase in the number of infected people due to its enhanced transmissibility. This all emphasizes the high demand for easy-to-use, cheap and available detection tests.


title: Multi-Agent Reinforcement Learning for Long-Term Network Resource Allocation through Auction: a V2X Application

abstract: We formulate offloading of computational tasks from a dynamic group of mobile agents (e.g., cars) as decentralized decision making among autonomous agents. We design an interaction mechanism that incentivizes such agents to align private and system goals by balancing between competition and cooperation. In the static case, the mechanism provably has Nash equilibria with optimal resource allocation. In a dynamic environment, this mechanism's requirement of complete information is impossible to achieve. For such environments, we propose a novel multi-agent online learning algorithm that learns with partial, delayed and noisy state information, thus greatly reducing information need. Our algorithm is also capable of learning from long-term and sparse reward signals with varying delay. Empirical results from the simulation of a V2X application confirm that through learning, agents with the learning algorithm significantly improve both system and individual performance, reducing up to 30% of offloading failure rate, communication overhead and load variation, increasing computation resource utilization and fairness. Results also confirm the algorithm's good convergence and generalization property in different environments.


title: POSET-RL: Phase ordering for Optimizing Size and Execution Time using Reinforcement Learning

abstract: The ever increasing memory requirements of several applications has led to increased demands which might not be met by embedded devices. Constraining the usage of memory in such cases is of paramount importance. It is important that such code size improvements should not have a negative impact on the runtime. Improving the execution time while optimizing for code size is a non-trivial but a significant task. The ordering of standard optimization sequences in modern compilers is fixed, and are heuristically created by the compiler domain experts based on their expertise. However, this ordering is sub-optimal, and does not generalize well across all the cases. We present a reinforcement learning based solution to the phase ordering problem, where the ordering improves both the execution time and code size. We propose two different approaches to model the sequences: one by manual ordering, and other based on a graph called Oz Dependence Graph (ODG). Our approach uses minimal data as training set, and is integrated with LLVM. We show results on x86 and AArch64 architectures on the benchmarks from SPEC-CPU 2006, SPEC-CPU 2017 and MiBench. We observe that the proposed model based on ODG outperforms the current Oz sequence both in terms of size and execution time by 6.19% and 11.99% in SPEC 2017 benchmarks, on an average.


title: Formulation of an equivalent GNF model as an efficient approximation for flow of polymer solutions described by FENE-P

abstract: The molecular constitutive models, like FENE-P for polymer solutions, are known to have convergence issues at relatively larger flow rates. In this study, we investigate the possibility of a numerically efficient GNF-based approximation of FENE-P, which would closely approximate the flow field. Firstly, we compare the flow fields predicted by FENE-P and an equivalent GNF model. For these studies, we considered the flow around a sphere and selected the Carreau-Yasuda model as the representative GNF. This is made equivalent to the FENE-P by selecting parameters to equalize the viscosity-shear rate dependence. Our results show severe deficiencies of the GNF model, owing to its inability to account for chain stretching, particularly near the stagnation points. Next, the effect of extensional components on the local viscosity was added by formulating an equivalent GNF-X [Journal of Rheology 64, 493 (2020)] model. Even this failed to capture the asymmetry in the stress and flow profiles and predicted very large stresses at both stagnation points, relative to FENE-P. Hence, we proposed a novel modified formalism (denoted as GNF-XM) that was able to capture all trends successfully. The drag coefficients from GNF-XM agreed well with FENE-P predictions for all flow rates considered. Significantly, the computational times required to solve the flow field with GNF-XM is about an order of magnitude lower than that of FENE-P, especially at higher flow rates. Thus, we have successfully formulated a highly efficient GNF-based approximation to the FENE-P, whose formalism can be extended to other similarly complicated constitutive models.


title: Optical guiding in 50-meter-scale air waveguides

abstract: The distant projection of high peak and average power laser beams in the atmosphere is a longstanding goal with a wide range of applications. Our early proof-of-principle experiments [Phys. Rev. X 4, 011027 (2014)] presented one solution to this problem, employing the energy deposition of femtosecond filaments in air to sculpt millisecond lifetime sub-meter length air waveguides. Here, we demonstrate air waveguiding at the 50 meter scale, 60X longer, making many practical applications now possible. We employ a new method for filament energy deposition: multi-filamentation of Laguerre-Gaussian LG01 "donut" modes. We first investigate the detailed physics of this scheme over a shorter 8 m in-lab propagation range corresponding to ~13 Rayleigh lengths of the guided pulse. We then use these results to demonstrate optical guiding over ~45 m in the hallway adjacent to the lab, corresponding to ~70 Rayleigh lengths. Injection of a continuous wave probe beam into these waveguides demonstrates very long lifetimes of tens of milliseconds.


title: First-principles phonon calculations of thermal expansion path of Fe2Mo Laves phase

abstract: Precipitation of the topologically close-packed Fe2Mo Laves phase at the interface between the nuclear fuel and the fuel element cladding can significantly weaken the strength characteristics of the cladding and fuel. Despite the importance of designing materials for the cladding of fuel rods, the thermodynamic properties and the trajectory of the thermal expansion path of the Fe2Mo remain poorly understood. The thermodynamic properties of the Fe2Mo have been studied using the finite-temperature quantum mechanical calculations within the frame of the density functional theory under the quasi-harmonic approximation. The vibrational contribution to the free energy was obtained using phonon calculations. The thermal expansion path of Fe2Mo was predicted by comparing between free energies calculated in different directions. A path with the least energy was chosen as the trajectory of thermal expansion. The obtained result was compared with the path calculated in previous theoretical work used the Debye-Gruneisen approach and accounted magnetic subsystem to calculate the vibrational and magnetic contributions to the free energy. This comparison reveals that these two approaches are in good agreement with each other. The work shows that the Fe2Mo possesses a non-isotropic thermal expansion. The heat capacity and volumetric expansion at constant pressure are modeled. The calculated results analyzed and are in satisfactory agreement with the experimental data. Obtained results can be useful for further design of fuel element cladding materials intended for generation IV reactors, the operating temperature of which should be above 873 K.


title: Abstract error analysis for Cahn--Hilliard type equations with dynamic boundary conditions

abstract: This work addresses the problem of solving the Cahn-Hilliard equation numerically. For that we introduce an abstract formulation for Cahn-Hilliard type equations with dynamic boundary conditions, we conduct the spatial semidiscretization via finite elements and prove error bounds based on the technique of energy estimates. The variational formulation for Cahn-Hilliard/Cahn-Hilliard coupling, will apply to a larger abstract class of problems and is similar to the usual weak formulation of parabolic problems. In contrast to problems with non dynamic boundary conditions, the Hilbert spaces $L^2(\Omega)$ and $H^1(\Omega)$ are exchanged with the spaces $L^2(\Omega)\times L^2(\Gamma)$ and $\lbrace v\in H^1(\Omega): \gamma v \in H^1(\Gamma)\rbrace$, respectively. Because we are considering a fourth-order differential equation, which will be described by a system of two second-order differential equations, the variational formulation also consists of a system of two equations.


title: A High-Quality and Large-Scale Dataset for English-Vietnamese Speech Translation

abstract: In this paper, we introduce a high-quality and large-scale benchmark dataset for English-Vietnamese speech translation with 508 audio hours, consisting of 331K triplets of (sentence-lengthed audio, English source transcript sentence, Vietnamese target subtitle sentence). We also conduct empirical experiments using strong baselines and find that the traditional "Cascaded" approach still outperforms the modern "End-to-End" approach. To the best of our knowledge, this is the first large-scale English-Vietnamese speech translation study. We hope both our publicly available dataset and study can serve as a starting point for future research and applications on English-Vietnamese speech translation. Our dataset is available at https://github.com/VinAIResearch/PhoST


title: Measurement of hyperfine constants and the isotope shift of rubidium 5P$_{1/2}$ excited-state using Saturated Absorption Spectroscopy

abstract: The Saturated Absorption Spectroscopy (SAS) was performed to measure the hyperfine energy splittings of rubidium 5P$_{1/2}$ excited state using a homemade external-cavity diode laser (ECDL) operating at 795 nm. Any nonlinearities associated with ECDL scans were removed by using a low-expansion confocal Fabry-Perot cavity and hence created a linearized frequency axis for the spectra collected in a fully automated fashion. We report our measurements for the magnetic dipole coupling constants 120.79(29) and 407.75(50) for $^{85}Rb$ and $^{87}Rb$ respectively.


title: Differentially Private Fr\'echet Mean on the Manifold of Symmetric Positive Definite (SPD) Matrices with log-Euclidean Metric

abstract: Differential privacy has become crucial in the real-world deployment of statistical and machine learning algorithms with rigorous privacy guarantees. The earliest statistical queries, for which differential privacy mechanisms have been developed, were for the release of the sample mean. In Geometric Statistics, the sample Fr\'echet mean represents one of the most fundamental statistical summaries, as it generalizes the sample mean for data belonging to nonlinear manifolds. In that spirit, the only geometric statistical query for which a differential privacy mechanism has been developed, so far, is for the release of the sample Fr\'echet mean: the \emph{Riemannian Laplace mechanism} was recently proposed to privatize the Fr\'echet mean on complete Riemannian manifolds. In many fields, the manifold of Symmetric Positive Definite (SPD) matrices is used to model data spaces, including in medical imaging where privacy requirements are key. We propose a novel, simple and fast mechanism - the \emph{tangent Gaussian mechanism} - to compute a differentially private Fr\'echet mean on the SPD manifold endowed with the log-Euclidean Riemannian metric. We show that our new mechanism has significantly better utility and is computationally efficient -- as confirmed by extensive experiments.


title: Snowpack Estimation in Key Mountainous Water Basins from Openly-Available, Multimodal Data Sources

abstract: Accurately estimating the snowpack in key mountainous basins is critical for water resource managers to make decisions that impact local and global economies, wildlife, and public policy. Currently, this estimation requires multiple LiDAR-equipped plane flights or in situ measurements, both of which are expensive, sparse, and biased towards accessible regions. In this paper, we demonstrate that fusing spatial and temporal information from multiple, openly-available satellite and weather data sources enables estimation of snowpack in key mountainous regions. Our multisource model outperforms single-source estimation by 5.0 inches RMSE, as well as outperforms sparse in situ measurements by 1.2 inches RMSE.


title: Challenges and Opportunities for Simultaneous Multi-functional Networks in the UHF Bands

abstract: Multi-functional wireless networks are rapidly evolving and aspire to become a promising attribute of the upcoming 6G networks. Enabling multiple simultaneous networking functions with a single radio fosters the development of more integrated and simpler equipment, overcoming design and technology barriers inherited from radio systems of the past. We are seeing numerous trends exploiting these features in newly designed radios, such as those operating on the mmWave band. In this article, however, we carefully analyze the challenges and opportunities for multi-functional wireless networks in UHF bands, advocating the reuse of existing infrastructures and technologies, and exploring the possibilities of expanding their functionality without requiring architectural changes. We believe that both modern and legacy technologies can be turned into multi-functional systems if the right scientific and technological challenges are properly addressed. This transformation can foster the development of new applications and extend the useful life of these systems, contributing to a more sustainable digitization by delaying equipment obsolescence.


title: Fast 3D Sparse Topological Skeleton Graph Generation for Mobile Robot Global Planning

abstract: In recent years, mobile robots are becoming ambitious and deployed in large-scale scenarios. Serving as a high-level understanding of environments, a sparse skeleton graph is beneficial for more efficient global planning. Currently, existing solutions for skeleton graph generation suffer from several major limitations, including poor adaptiveness to different map representations, dependency on robot inspection trajectories and high computational overhead. In this paper, we propose an efficient and flexible algorithm generating a trajectory-independent 3D sparse topological skeleton graph capturing the spatial structure of the free space. In our method, an efficient ray sampling and validating mechanism are adopted to find distinctive free space regions, which contributes to skeleton graph vertices, with traversability between adjacent vertices as edges. A cycle formation scheme is also utilized to maintain skeleton graph compactness. Benchmark comparison with state-of-the-art works demonstrates that our approach generates sparse graphs in a substantially shorter time, giving high-quality global planning paths. Experiments conducted in real-world maps further validate the capability of our method in real-world scenarios. Our method will be made open source to benefit the community.


title: Fast and Robust Geometric Two-Qubit Gates for Superconducting Qubits and beyond

abstract: Quantum protocols based on adiabatic evolution are remarkably robust against imperfections of control pulses and system uncertainties. While adiabatic protocols have been successfully implemented for quantum operations such as quantum state transfer and single-qubit gates, their use for geometric two-qubit gates remains a challenge. In this paper, we propose a general scheme to realize robust geometric two-qubit gates in multi-level qubit systems where the interaction between the qubits is mediated by an auxiliary system (such as a bus or coupler). While our scheme utilizes Stimulated Raman Adiabatic Passage (STIRAP), it is substantially simpler than STIRAP-based gates that have been proposed for atomic platforms, requiring fewer control tones and ancillary states, as well as utilizing only a generic dispersive interaction. We also show how our gate can be accelerated using a shortcuts-to-adiabaticity approach, allowing one to achieve a gate that is both fast and relatively robust. We present a comprehensive theoretical analysis of the performance of our two-qubit gate in a parametrically-modulated superconducting circuits comprising two fluxonium qubits coupled to an auxiliary system.


title: Quadratic Enhancement in the Reliability of Collective Quantum Engines

abstract: We study fluctuations in many-body quantum heat engines operating in the presence of collective system-bath interactions. We show that collective effects in open quantum systems can be harnessed to develop highly consistent many-body quantum engines. We consider quantum Otto engines, modeled by $n$ spins collectively coupled to thermal baths. Our results show that collective effects can significantly reduce the fluctuations in the output work, quantified by high reliability ($r$) and low thermodynamic uncertainty. In contrast to independent engines, we demonstrate a quadratic enhancement of the reliability $r$ for their collective counterparts. We extend our analysis to the case of interacting spin models commonly studied in many-body physics, such as the Lipkin-Meshkov-Glick (LMG) model, thereby broadening the regime of applicability of collective effects in quantum thermal machines significantly. This paves the way forward for realistic collective quantum thermal machines in many body systems.


title: PNV J00444033+4113068: early superhumps with 0.7 mag amplitude and non-red color

abstract: In the first days of WZ Sge-type dwarf nova (DN) outbursts, the 2:1 resonance induces a spiral arm structure in the accretion disk, which is observed as early superhumps in optical light curves. This paper reports our optical observations of an eclipsing WZ Sge-type DN PNV J00444033+4113068 during its 2021 superoutburst with the 3.8m Seimei telescope and through VSNET collaboration. The eclipse analysis gave its orbital period as 0.055425534(1) d. Our observations confirmed early superhumps with an amplitude of 0.7 mag, the largest amplitude among known WZ Sge-type DNe. More interestingly, its early superhumps became the reddest around their secondary minimum, whereas other WZ Sge-type DNe show the reddest color around the early superhump maximum. The spectrum around the peak of the outburst showed the double-peaked emission lines of He II 4686\AA~ and H$\alpha$ with a peak separation of $\ge 700$ km/s, supporting a very high-inclination system. With the early superhump mapping, the unique profile and color of the early superhump of PNV J00444033+4113068 are successfully reproduced by the accretion disk with vertically extended double arm structure. Therefore, the large amplitude and unique color behavior of the early superhumps in PNV J00444033+4113068 can be explained by the 2:1 resonance model along with other WZ Sge-type DNe.


title: Capacity Scaling Law in Massive MIMO with Antenna Selection

abstract: Antenna selection is capable of handling the cost and complexity issues in massive multiple-input multiple-output (MIMO) channels. The sum-rate capacity of a multiuser massive MIMO uplink channel is characterized under the Nakagami fading. A mathematically tractable sum-rate capacity upper bound is derived for the considered system. Moreover, for a sufficiently large base station (BS) antenna number, a deterministic equivalent (DE) of the sum-rate bound is derived. Based on this DE, the sum-rate capacity is shown to grow double logarithmically with the number of BS antennas. The validity of the analytical result is confirmed by numerical experiments.


title: Probing early structure and model-independent neutrino mass with high-redshift CMB lensing mass maps

abstract: CMB lensing maps probe the mass distribution in projection out to high redshifts, but significant sensitivity to low-redshift structure remains. In this paper we discuss a method to remove the low-redshift contributions from CMB lensing mass maps by subtracting suitably scaled galaxy density maps, nulling the low redshift structure with a model-insensitive procedure that is similar to delensing. This results in a high-$z$-only mass map that can provide a probe of structure growth at uniquely high redshifts: if systematics can be controlled, we forecast that CMB-S4 lensing combined with a Rubin-LSST-like galaxy survey can probe the amplitude of structure at redshifts $z>3.75$ ($z>5$) to within $2.3\%$ ($3.3\%$). We then discuss other example applications of such high-$z$ CMB lensing maps. In standard analyses of CMB lensing, assuming the wrong dark energy model (or wrong model parametrization) can lead to biases in neutrino mass constraints. In contrast, we show with forecasts that a high-$z$ mass map constructed from CMB-S4 lensing and LSST galaxies can provide a nearly model-independent neutrino mass constraint, with only negligible sensitivity to the presence of non-standard dark energy models, irrespective of their parametrization.


title: Distinctive Image Captioning via CLIP Guided Group Optimization

abstract: Image captioning models are usually trained according to human annotated ground-truth captions, which could generate accurate but generic captions. In this paper, we focus on generating distinctive captions that can distinguish the target image from other similar images. To evaluate the distinctiveness of captions, we introduce a series of metrics that use large-scale vision-language pre-training model CLIP to quantify the distinctiveness. To further improve the distinctiveness of captioning models, we propose a simple and effective training strategy that trains the model by comparing target image with similar image group and optimizing the group embedding gap. Extensive experiments are conducted on various baseline models to demonstrate the wide applicability of our strategy and the consistency of metric results with human evaluation. By comparing the performance of our best model with existing state-of-the-art models, we claim that our model achieves new state-of-the-art towards distinctiveness objective.


title: Extremal affine subspaces and Khintchine-Jarn\'ik type theorems

abstract: We prove a conjecture of Kleinbock which gives a clear-cut classification of all extremal affine subspaces of $\mathbb{R}^n$. We also give an essentially complete classification of all Khintchine type affine subspaces, except for some boundary cases within two logarithmic scales. More general Jarn\'ik type theorems are proved as well, sometimes without the monotonicity of the approximation function. These results follow as consequences of our novel estimates for the number of rational points close to an affine subspace in terms of diophantine properties of its defining matrix. Our main tool is the multidimensional large sieve inequality and its dual form.


title: Coherent Time-Domain Canceling of Interference for Radio Astronomy

abstract: Radio astronomy is vulnerable to interference from a variety of anthropogenic sources. Among the many strategies for mitigation of this interference is coherent time-domain canceling (CTC), which ideally allows one to "look through" interference, as opposed to avoiding the interference or deleting the afflicted data. However, CTC is difficult to implement, not well understood, and at present this strategy is not in regular use at any major radio telescope. This paper presents a review of CTC including a new comprehensive study of the capabilities and limitations of CTC using metrics relevant to radio astronomy, including fraction of interference power removed and increase in noise. This work is motivated by the emergence of a new generation of communications systems which pose a significantly increased threat to radio astronomy and which may overwhelm mitigation methods now in place.


title: Characterization of aerogel scattering filters for astronomical telescopes

abstract: We have developed a suite of novel infrared-blocking filters made by embedding scattering particles in a polymer aerogel substrate. Our developments allow us to tune the spectral performance of the filters based on both the composition of the base aerogel material and the properties of the scattering particles. Our filters are targeted for use in a variety of applications, from ground-based CMB experiments to planetary science probes. We summarize the formulations we have fabricated and tested to date, including several polyimide base aerogel formulations incorporating a range of size distributions of diamond scattering particles. We also describe the spectral characterization techniques used to measure the filters' optical properties, including the development of a mm-wave Fourier transform spectrometer testbed.


title: Algebra of operators in an AdS-Rindler wedge

abstract: We discuss the algebra of operators in AdS-Rinlder wedge, particularly in AdS$_{5}$/CFT$_{4}$. We explicitly construct the algebra at $N=\infty$ limit and discuss its Type III$_{1}$ nature. We will consider $1/N$ corrections to the theory and using a novel way of renormalizing the area of Ryu-Takayanagi surface, describe how several divergences can be renormalized and the algebra becomes Type II$_{\infty}$. This will make it possible to associate a density matrix to any state in the Hilbert space and thus a von Neumann entropy.


title: First Come First Served: The Impact of File Position on Code Review

abstract: The most popular code review tools (e.g., Gerrit and GitHub) present the files to review sorted in alphabetical order. Could this choice or, more generally, the relative position in which a file is presented bias the outcome of code reviews? We investigate this hypothesis by triangulating complementary evidence in a two-step study. First, we observe developers' code review activity. We analyze the review comments pertaining to 219,476 Pull Requests (PRs) from 138 popular Java projects on GitHub. We found files shown earlier in a PR to receive more comments than files shown later, also when controlling for possible confounding factors: e.g., the presence of discussion threads or the lines added in a file. Second, we measure the impact of file position on defect finding in code review. Recruiting 106 participants, we conduct an online controlled experiment in which we measure participants' performance in detecting two unrelated defects seeded into two different files. Participants are assigned to one of two treatments in which the position of the defective files is switched. For one type of defect, participants are not affected by its file's position; for the other, they have 64% lower odds to identify it when its file is last as opposed to first. Overall, our findings provide evidence that the relative position in which files are presented has an impact on code reviews' outcome; we discuss these results and implications for tool design and code review. Data and materials: https://doi.org/10.5281/zenodo.6901285


title: Integrated Sensing and Communications: A Mutual Information-Based Framework

abstract: Integrated sensing and communications (ISAC) is potentially capable of circumventing the limitations of existing frequency-division sensing and communications (FDSAC) techniques. Hence, it has recently attracted significant attention. This article aims to propose a unified analytical framework for ISAC from a mutual information (MI) perspective. Based on the proposed framework, the sensing performance and the communication performance are evaluated by the sensing MI and the communication MI, respectively. The unity of this framework is originated from the fact that the sensing and communication (S\&C) performance metrics, i.e., the S\&C MI, have the similar physical and mathematical properties as well as the same unit of measurement. Based on this framework, the S\&C performance of downlink and uplink ISAC systems is investigated and compared with that of FDSAC systems. Along each considered system settings, numerical results are provided to demonstrate the superiority of ISAC over conventional FDSAC designs. Finally, promising open research directions are provided in the context of MI-based ISAC.


title: Software Security during Modern Code Review: The Developer's Perspective

abstract: To avoid software vulnerabilities, organizations are shifting security to earlier stages of the software development, such as at code review time. In this paper, we aim to understand the developers' perspective on assessing software security during code review, the challenges they encounter, and the support that companies and projects provide. To this end, we conduct a two-step investigation: we interview 10 professional developers and survey 182 practitioners about software security assessment during code review. The outcome is an overview of how developers perceive software security during code review and a set of identified challenges. Our study revealed that most developers do not immediately report to focus on security issues during code review. Only after being asked about software security, developers state to always consider it during review and acknowledge its importance. Most companies do not provide security training, yet expect developers to still ensure security during reviews. Accordingly, developers report the lack of training and security knowledge as the main challenges they face when checking for security issues. In addition, they have challenges with third-party libraries and to identify interactions between parts of code that could have security implications. Moreover, security may be disregarded during reviews due to developers' assumptions about the security dynamic of the application they develop. Data and materials: https://doi.org/10.5281/zenodo.6875435


title: Fast neutrino cooling in the accreting neutron star MXB 1659-29

abstract: Modelling of crust heating and cooling across multiple accretion outbursts of the low mass X-ray binary MXB 1659-29 indicates that the neutrino luminosity of the neutron star core is consistent with direct Urca reactions occurring in $\sim 1\%$ of the core volume. We investigate this scenario with neutron star models that include a detailed equation of state parametrized by the slope of the nuclear symmetry energy $L$, and a range of neutron and proton superfluid gaps. We find that the predicted neutron star mass depends sensitively on $L$ and the assumed gaps. We discuss which combinations of superfluid gaps reproduce the inferred neutrino luminosity. Larger values of $L\gtrsim 80\ {\rm MeV}$ require superfluidity to suppress dUrca reactions in low mass neutron stars, i.e. that the proton or neutron gap is sufficiently strong and extends to high enough density. However, the largest gaps give masses near the maximum mass, making it difficult to accommodate colder neutron stars. We consider models with reduced dUrca normalization as an approximation of alternative, less efficient, fast cooling processes in exotic cores. We find solutions with a larger emitting volume, providing a more natural explanation for the observed neutrino luminosity, provided the fast cooling process is within a factor of $\sim 1000$ of dUrca. The heat capacities of our models span the range from fully-paired to fully-unpaired nucleons meaning that long term observations of core cooling could distinguish between models. We discuss the impact of future constraints on neutron star mass, radius and the density dependence of the symmetry energy.


title: Towards Weak Information Theory: Weak-Joint Typicality Decoding Using Support Vector Machines May Lead to Improved Error Exponents

abstract: In this paper, the authors report a way to use concepts from statistical learning to gain an advantage in terms of error exponents while communicating over a discrete memoryless channel. The study utilizes the simulation capability of the scientific computing package MATLAB to show that the proposed decoding method performs better than the traditional method of joint typicality decoding. The advantage is secured by modifying the traditional specification of what constitutes a decoding error. This is justified by the paradigm, also used in the program of `utilizing' noisy feedback, that one ought not to declare a condition as an error if some further processing can extract useful information from it.


title: Analytical and numerical treatment of continuous ageing in the voter model

abstract: The conventional voter model is modified so that an agent's switching rate depends on the `age' of the agent, that is, the time since the agent last switched opinion. In contrast to previous work, age is continuous in the present model. We show how the resulting individual-based system with non-Markovian dynamics and concentration-dependent rates can be handled both computationally and analytically. Lewis' thinning algorithm can be modified in order to provide an efficient simulation method. Analytically, we demonstrate how the asymptotic approach to an absorbing state (consensus) can be deduced. We discuss three special cases of the age dependent switching rate: one in which the concentration of voters can be approximated by a fractional differential equation, another for which the approach to consensus is exponential in time, and a third case in which the system reaches a frozen state instead of consensus. Finally, we include the effects of spontaneous change of opinion, i.e., we study a noisy voter model with continuous ageing. We demonstrate that this can give rise to a continuous transition between coexistence and consensus phases. We also show how the stationary probability distribution can be approximated, despite the fact that the system cannot be described by a conventional master equation.


title: Characterization of Commercial Thermoelectric Modules for Precision Heat FLux Measurement

abstract: In this article, we present a cost-effective approach to the precision measurement of heat flux using commercial thermoelectric modules (TEMs). Two different methods of measuring heat flux with TEMs are investigated, namely passive mode based on the Seebeck effect and active mode based on the Peltier effect. For both modes, a TEM as a heat fluxmeter is calibrated to show a linear relation between the voltage across the TEM and the heat flow rate from 0 to 100 mW. While both modes exhibit sufficiently high sensitivities suitable for low heat flow measurement, active mode is shown to be $\sim$7 times more sensitive than passive mode. From the speculation on the origin of the measurement uncertainty, we propose a dual TEM scheme by operating the top TEM in passive mode while its bottom temperature maintains constant by the feedback-controlled bottom TEM. The dual-TEM scheme can suppress the sensitivity uncertainty by up to 4 times when compared to the single-TEM passive mode by stabilizing the bottom temperature. The response time of a 1.5 cm $\times$ 1.5 cm TEM is measured to be 8.90 $\pm$ 0.97 seconds for heating and 10.83 $\pm$ 0.65 seconds for cooling, which is slower than commercial heat fluxmeters but still fast enough to measure heat flux with a time resolution on the order of 10 seconds. We believe that the obtained results can facilitate the use of a commercial TEM for heat flux measurement in various thermal experiments


title: Modeling Strangeness Enhancements to resolve the Muon Excess in Cosmic Ray Extensive Air Shower Data

abstract: Experimental observations of extensive air showers have revealed an excess of the muon content with respect to their theoretical simulations, which we refer to as the muon puzzle. This muon puzzle hampers a precise determination of the ultra-high-energy cosmic ray mass composition. We investigate the potential of producing states of dense quark-gluon matter (which we call fireballs) to resolve the muon puzzle as quantified with data from the Pierre Auger Observatory on the depth of the shower maximum and the number of muons at ground. Adopting a phenomenological fireball model, we find that the inelasticity enhancement associated with the formation of a plasma state is in tension with data on the electromagnetic longitudinal shower development. Instead, we restrict the fireball model to only enhance the strangeness produced in Standard Model hadronic interactions, and dub this model the strangeball model. With an analytic approach based on the Heitler-Matthews model we then find explicit sets of strangeball parameters that resolve the muon puzzle. Constraints from data on shower-to-shower fluctuations of the muon number require strangeness enhancements already at energies accessible to current-generation collider experiments. At Tevatron and LHC energies we estimate 40% of the interactions to produce strangeballs, corresponding to a 5-9% increase of the average fraction of energy retained in the hadronic cascade compared to predictions from current hadronic interaction models. A comparison with relevant measurements of the LHCf and LHCb detectors does not directly exclude this scenario, though the obtained tension with LHCb suggests a stringent test at 14 TeV.


title: General relativistic moving-mesh hydrodynamics simulations with AREPO and applications to neutron star mergers

abstract: We implement general relativistic hydrodynamics in the moving-mesh code AREPO. We also couple a solver for the Einstein field equations employing the conformal flatness approximation. The implementation is validated by evolving isolated static neutron stars using a fixed metric or a dynamical spacetime. In both tests the frequencies of the radial oscillation mode match those of independent calculations. We run the first moving-mesh simulation of a neutron star merger. The simulation includes a scheme to adaptively refine or derefine cells and thereby adjusting the local resolution dynamically. The general dynamics are in agreement with independent smoothed particle hydrodynamics and static-mesh simulations of neutron star mergers. Coarsely comparing, we find that dynamical features like the post-merger double-core structure or the quasi-radial oscillation mode persist on longer time scales, possibly reflecting a low numerical diffusivity of our method. Similarly, the post-merger gravitational wave emission shows the same features as observed in simulations with other codes. In particular, the main frequency of the post-merger phase is found to be in good agreement with independent results for the same binary system, while, in comparison, the amplitude of the post-merger gravitational wave signal falls off slower, i.e. the post-merger oscillations are less damped. The successful implementation of general relativistic hydrodynamics in the moving-mesh AREPO code, including a dynamical spacetime evolution, provides a fundamentally new tool to simulate general relativistic problems in astrophysics.


title: Label-Free Synthetic Pretraining of Object Detectors

abstract: We propose a new approach, Synthetic Optimized Layout with Instance Detection (SOLID), to pretrain object detectors with synthetic images. Our "SOLID" approach consists of two main components: (1) generating synthetic images using a collection of unlabelled 3D models with optimized scene arrangement; (2) pretraining an object detector on "instance detection" task - given a query image depicting an object, detecting all instances of the exact same object in a target image. Our approach does not need any semantic labels for pretraining and allows the use of arbitrary, diverse 3D models. Experiments on COCO show that with optimized data generation and a proper pretraining task, synthetic data can be highly effective data for pretraining object detectors. In particular, pretraining on rendered images achieves performance competitive with pretraining on real images while using significantly less computing resources. Code is available at https://github.com/princeton-vl/SOLID.


title: Environment assisted superballistic scaling of conductance

abstract: We find that, in the presence of weak incoherent effects from surrounding environments, the zero temperature conductance of nearest neighbour tight-binding chains exhibits a counter-intuitive power-law growth with system length at band-edges, indicating superballistic scaling. This fascinating environment assisted superballistic scaling of conductance occurs over a finite but extended regime of system lengths. This scaling regime can be systematically expanded by decreasing the coupling to the surrounding environments. There is no corresponding analog of this behavior for isolated systems. This superballistic scaling stems from an intricate interplay of incoherent effects from surrounding environments and exceptional points of the system's transfer matrix that occur at every band-edge.


title: Anyons, Zitterbewegung and dynamical phase transitions in topologically nontrivial systems

abstract: Nontrivial topology in physical systems is the driving force behind many phenomena. Notably, phases of matter must be classified in part by their topological properties. Phases with topological order (TO), such as the fractional quantum Hall effect (QHE), can support anyonic excitations obeying fractional statistics with potential application in topological quantum computing. States lacking intrinsic TO can still be in topological phases provided certain symmetries are imposed. On their own, these symmetry-protected phases do not support anyons, but they can still have other interesting features, such as protected boundary states. In this thesis we present our research into several nontrivial systems. First, we present the results on light propagation in the valley modes of inversion-symmetry broken honeycomb lattices. We find that a rotating spiral pattern, leading to Zitterbewegung, arises in the intensity profile of the beam as a result of the nontrivial topology of the valleys. Next, we present the numerical demonstration of dynamical topological phase transitions driven by nonlinearity of the photonic medium, which occur in soliton SSH lattices. The phase transitions, marked by the appearance of topological edge states in the band gap, occur due to the setup which enables continually changing values of the intracell and intercell soliton couplings. Finally, we propose a scheme for creating and manipulating synthetic anyons in a noninteracting system by perturbing it with specially tailored localized probes. The external probes are needed because noninteracting systems do not possess the kind of TO required to support anyons. We start from a 2DEG in a uniform magnetic field (in an integer QHE state) and introduce thin solenoids carrying a fractional magnetic flux. We find a suitable ground state and demonstrate the fractional braiding statistics in the coordinates of the solenoids.


title: CP-violation, Asymmetries and Interferences in $t \bar{t} \phi$

abstract: We use the associated production of top-quark pairs with a generic scalar boson at the LHC to explore the sensitivity of a large set of observables to the sign of the CP mixing angle, present in the coupling between the scalar boson and the top quarks. The mass of the scalar boson is set to $m_{\phi}=125$ GeV and its coupling to top-quarks is varied such that $\alpha=$ 0$^\circ$, 22.5$^\circ$, 45.0$^\circ$, 67.5$^\circ$, 90.0$^\circ$, 135.0$^\circ$ and 180.0$^\circ$. Dileptonic final states of the $t\bar{t}\phi$ system are used, with the scalar boson decaying as $\phi\rightarrow b\bar{b}$. A new method to reconstruct the scalar mass, originally designed for the low mass regime is used, improving the resolution of the Higgs mass by roughly a factor of two. A full phenomenological analysis is performed using Standard Model background and signal events generated with MadGraph5aMC@NLO and reconstructed using a kinematical fit. The most sensitive CP-observables are selected to compute Confidence Level (CL) limits as a function of the sign of the top quark Yukawa couplings to the scalar boson. We also explore the sensitivity to interference terms using differential distributions and angular asymmetries. Given the significant difference between the pure scalar and pure pseudo-scalar production cross section values, it is unlikely the $t\bar{t}\phi$ channel alone will be sensitive to the sign of the CP-mixing angle or interference terms, even at the end of the LHC. Using the $b_2^{t\bar{t}\phi}$ and $b_4^{t\bar{t}\phi}$ variables, exclusion limits at 95\% CL for the CP-even and CP-odd components of the top quark Yukawa couplings are expected to be set to $\tilde{\kappa} \in$ [-0.698,+0.698] and $|\kappa| \in$ [0.878,1.04], respectively, at the end of the High Luminosity phase of the LHC (HL-LHC) by using the dileptonic decay channel alone.


title: Unitary canonical forms over Clifford algebras, and an observed unification of some real-matrix decompositions

abstract: We show that the spectral theorem -- which we understand to be a statement that every self-adjoint matrix admits a certain type of canonical form under unitary similarity -- admits analogues over other $*$-algebras distinct from the complex numbers. If these $*$-algebras contain nilpotents, then it is shown that there is a consistent way in which many classic matrix decompositions -- such as the Singular Value Decomposition, the Takagi decomposition, the skew-Takagi decomposition, and the Jordan decomposition, among others -- are immediate consequences of these. If producing the relevant canonical form of a self-adjoint matrix were a subroutine in some programming language, then the corresponding classic matrix decomposition would be a 1-line invocation with no additional steps. We also suggest that by employing operator overloading in a programming language, a numerical algorithm for computing a unitary diagonalisation of a complex self-adjoint matrix would generalise immediately to solving problems like SVD or Takagi. While algebras without nilpotents (like the quaternions) allow for similar unifying behaviour, the classic matrix decompositions which they unify are never obtained as easily. In the process of doing this, we develop some spectral theory over Clifford algebras of the form $\cl_{p,q,0}(\mathbb R)$ and $\cl_{p,q,1}(\mathbb R)$ where the former is admittedly quite easy. We propose a broad conjecture about spectral theorems.


title: Improving performance in multi-objective decision-making in Bottles environments with soft maximin approaches

abstract: Balancing multiple competing and conflicting objectives is an essential task for any artificial intelligence tasked with satisfying human values or preferences. Conflict arises both from misalignment between individuals with competing values, but also between conflicting value systems held by a single human. Starting with principle of loss-aversion, we designed a set of soft maximin function approaches to multi-objective decision-making. Bench-marking these functions in a set of previously-developed environments, we found that one new approach in particular, 'split-function exp-log loss aversion' (SFELLA), learns faster than the state of the art thresholded alignment objective method (Vamplew et al, 2021) on three of four tasks it was tested on, and achieved the same optimal performance after learning. SFELLA also showed relative robustness improvements against changes in objective scale, which may highlight an advantage dealing with distribution shifts in the environment dynamics. Due to publishing rules, further work could not be presented in the preprint, but in the final published version, we will further compare SFELLA to the multi-objective reward exponentials (MORE) approach (Rolf, 2020), demonstrating that SFELLA performs similarly to MORE in a simple previously-described foraging task, but in a modified foraging environment with a new resource that was not depleted as the agent worked, SFELLA collected more of the new resource with very little cost incurred in terms of the old resource. Overall, we found SFELLA useful for avoiding problems that sometimes occur with a thresholded approach, and more reward-responsive than MORE while retaining its conservative, loss-averse incentive structure.


title: Visual-Inertial Multi-Instance Dynamic SLAM with Object-level Relocalisation

abstract: In this paper, we present a tightly-coupled visual-inertial object-level multi-instance dynamic SLAM system. Even in extremely dynamic scenes, it can robustly optimise for the camera pose, velocity, IMU biases and build a dense 3D reconstruction object-level map of the environment. Our system can robustly track and reconstruct the geometries of arbitrary objects, their semantics and motion by incrementally fusing associated colour, depth, semantic, and foreground object probabilities into each object model thanks to its robust sensor and object tracking. In addition, when an object is lost or moved outside the camera field of view, our system can reliably recover its pose upon re-observation. We demonstrate the robustness and accuracy of our method by quantitatively and qualitatively testing it in real-world data sequences.


title: One person's modus ponens...: Comment on "The Markov blanket trick: On the scope of the free energy principle and active inference" by Raja and colleagues (2021)

abstract: In this comment on "The Markov blanket trick: On the scope of the free energy principle and active inference" by Raja and colleagues (2021) in Physics of Life Reviews, I argue that the argument presented by the authors is valid; however, I claim that the argument contains a flawed premise, which undermines their conclusions. In addition, I argue that work on the FEP that has appeared since the target paper was published underwrites a cogent response to the issues that are raised by Raja and colleagues.


title: MIMO Super-Twisting Controller using a passivity-based design

abstract: A novel MIMO homogeneous Super-Twisting Algorithm is proposed in this paper for nonlinear systems with relative degree one, having a time and state-varying uncertain control matrix. The uncertainty is represented by a constant but unknown left matrix factor. Sufficient conditions for stability with full-matrix control gains are established, in contrast to the usual scalar gains. For this a smooth Lyapunov function, based on a passivity interpretation, is used. Moreover, continuous and homogeneous approximations of the classical discontinuous Super-Twisting algorithm are obtained, using a unified analysis method.


title: Neutrino Decoherence and the Mass Hierarchy in the JUNO Experiment

abstract: The finite size of a neutrino wavepacket at creation can affect its oscillation probability. Here, we consider the electron antineutrino wavepacket and decoherence in the context of the nuclear reactor based experiment JUNO. Given JUNO's high expected statistics [$\sim$100k IBD events ($\bar{\nu}_e p \rightarrow e^+ n$)], long baseline ($\sim$53\,km), and excellent energy resolution [$\sim$$0.03/\sqrt{E_{\mathrm{vis}}~\mathrm{(MeV)}}$], its sensitivity to the size of the wavepacket is expected to be quite strong. Unfortunately, this sensitivity may weaken the experiment's ability to measure the orientation of the neutrino mass hierarchy for currently allowed values of the wavepacket size. Here, we report both the JUNO experiment's ability to determine the hierarchy orientation in the presence of a finite wavepacket and its simultaneous sensitivity to size of the wavepacket and the hierarchy. We find that wavepacket effects are relevant for the hierarchy determination up to nearly two orders of magnitude above the current experimental lower limit on the size, noting that there is no theoretical consensus on the expectation of this value. We also consider the effect in the context of other aspects of JUNO's nominal three-neutrino oscillation measurement physics program and the prospect of future enhancements to sensitivity, including from precise measurements of $\Delta m^2_{3l}$ and a near detector.


title: Self-Supervised Contrastive Representation Learning for 3D Mesh Segmentation

abstract: 3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to annotate due to their high geometrical complexity. Specifically, creating segmentation masks for meshes is tedious and time-consuming. Therefore, it is desirable to train segmentation networks with limited-labeled data. Self-supervised learning (SSL), a form of unsupervised representation learning, is a growing alternative to fully-supervised learning which can decrease the burden of supervision for training. We propose SSL-MeshCNN, a self-supervised contrastive learning method for pre-training CNNs for mesh segmentation. We take inspiration from traditional contrastive learning frameworks to design a novel contrastive learning algorithm specifically for meshes. Our preliminary experiments show promising results in reducing the heavy labeled data requirement needed for mesh segmentation by at least 33%.


title: Complete Calabi-Yau metrics from smoothing Calabi-Yau complete intersections

abstract: We construct complete Calabi-Yau metrics on non-compact manifolds that are smoothings of an initial complete intersection $V_0$ that is a Calabi-Yau cone, extending the work of Sz\'ekelyhidi (2019). The constructed Calabi-Yau manifold has tangent cone at infinity given by $\mathbb{C} \times V_0$. This construction produces Calabi-Yau metrics with fibers having varying complex structures and possibly isolated singularities.


title: Estimating density, velocity, and pressure fields in supersonic flow using physics-informed BOS

abstract: We report a new workflow for background-oriented schlieren (BOS), termed "physics-informed BOS," to extract density, velocity, and pressure fields from a pair of reference and distorted images. Our method uses a physics-informed neural network (PINN) to produce flow fields that simultaneously satisfy the measurement data and governing equations. For the high-speed flows of interest in this work, we specify a physics loss based on the Euler and irrotationality equations. BOS is a quantitative fluid visualization technique that is used to characterize high-speed flows. Images of a background pattern, positioned behind the target flow, are processed using computer vision and tomography algorithms to determine the density field. Crucially, BOS features a series of ill-posed inverse problems that require supplemental information (i.e., in addition to the images) to accurately reconstruct the flow. Current BOS workflows rely upon interpolation of the images or a penalty term to promote a globally- or piecewise-smooth solution. However, these algorithms are invariably incompatible with the flow physics, leading to errors in the density field. Physics-informed BOS directly reconstructs all the flow fields using a PINN that includes the BOS measurement model and governing equations. This procedure improves the accuracy of density estimates and also yields velocity and pressure data, which was not previously available. We demonstrate our approach by reconstructing synthetic data that corresponds to analytical and numerical phantoms as well as experimental measurements. Our physics-informed reconstructions are significantly more accurate than conventional BOS estimates. Further, to the best of our knowledge, this work represents the first use of a PINN to reconstruct a supersonic flow from experimental data of any kind.


title: Maximal Border Subrank Tensors

abstract: We prove a lower bound on the dimension of the set of maximal border subrank tensors. This is the first such bound of its type.


title: New physics contributions to moments of inclusive $b \to c$ semileptonic decays

abstract: Inclusive semileptonic $B\to X_c \ell \bar{\nu}_\ell$ decays, where $\ell = \mu,e$, are by now standard candles in the determination of the CKM element $|V_{cb}|$. These determinations rely on the heavy-quark expansion and use moments of decay spectra to extract the non-perturbative parameters directly from data under the standard model assumption. At the same time, new physics could influence the moments of the inclusive decay. In this paper, we compute power-corrections and next-to-leading order corrections in the strong coupling constant using the full basis of dimension-six new physics operators for the inclusive $B \to X_c \ell \bar{\nu}$ decay. We provide predictions for lepton energy, hadronic and leptonic invariant mass moments, and perform a phenomenological study to show the possible impact of new physics. Our results could be used to perform a global fit including new physics contributions.


title: LWGNet: Learned Wirtinger Gradients for Fourier Ptychographic Phase Retrieval

abstract: Fourier Ptychographic Microscopy (FPM) is an imaging procedure that overcomes the traditional limit on Space-Bandwidth Product (SBP) of conventional microscopes through computational means. It utilizes multiple images captured using a low numerical aperture (NA) objective and enables high-resolution phase imaging through frequency domain stitching. Existing FPM reconstruction methods can be broadly categorized into two approaches: iterative optimization based methods, which are based on the physics of the forward imaging model, and data-driven methods which commonly employ a feed-forward deep learning framework. We propose a hybrid model-driven residual network that combines the knowledge of the forward imaging system with a deep data-driven network. Our proposed architecture, LWGNet, unrolls traditional Wirtinger flow optimization algorithm into a novel neural network design that enhances the gradient images through complex convolutional blocks. Unlike other conventional unrolling techniques, LWGNet uses fewer stages while performing at par or even better than existing traditional and deep learning techniques, particularly, for low-cost and low dynamic range CMOS sensors. This improvement in performance for low-bit depth and low-cost sensors has the potential to bring down the cost of FPM imaging setup significantly. Finally, we show consistently improved performance on our collected real data.


title: On Rademacher Complexity-based Generalization Bounds for Deep Learning

abstract: We show that the Rademacher complexity-based approach can generate non-vacuous generalisation bounds on Convolutional Neural Networks (CNNs) for classifying a small number of classes of images. The development of new Talagrand's contraction lemmas for high-dimensional mappings between function spaces and CNNs for general Lipschitz activation functions is a key technical contribution. Our results show that the Rademacher complexity does not depend on the network length for CNNs with some special types of activation functions such as ReLU, Leaky ReLU, Parametric Rectifier Linear Unit, Sigmoid, and Tanh.


title: Recollections of Kip Thorne

abstract: Brief recollections by the author about how his work with Kip Thorne influenced his career in physics.

categories: physics.pop-ph astro-ph.HE gr-qc physics.hist-ph


title: Exploiting Shape Cues for Weakly Supervised Semantic Segmentation

abstract: Weakly supervised semantic segmentation (WSSS) aims to produce pixel-wise class predictions with only image-level labels for training. To this end, previous methods adopt the common pipeline: they generate pseudo masks from class activation maps (CAMs) and use such masks to supervise segmentation networks. However, it is challenging to derive comprehensive pseudo masks that cover the whole extent of objects due to the local property of CAMs, i.e., they tend to focus solely on small discriminative object parts. In this paper, we associate the locality of CAMs with the texture-biased property of convolutional neural networks (CNNs). Accordingly, we propose to exploit shape information to supplement the texture-biased CNN features, thereby encouraging mask predictions to be not only comprehensive but also well-aligned with object boundaries. We further refine the predictions in an online fashion with a novel refinement method that takes into account both the class and the color affinities, in order to generate reliable pseudo masks to supervise the model. Importantly, our model is end-to-end trained within a single-stage framework and therefore efficient in terms of the training cost. Through extensive experiments on PASCAL VOC 2012, we validate the effectiveness of our method in producing precise and shape-aligned segmentation results. Specifically, our model surpasses the existing state-of-the-art single-stage approaches by large margins. What is more, it also achieves a new state-of-the-art performance over multi-stage approaches, when adopted in a simple two-stage pipeline without bells and whistles.


title: Continual Reinforcement Learning with TELLA

abstract: Training reinforcement learning agents that continually learn across multiple environments is a challenging problem. This is made more difficult by a lack of reproducible experiments and standard metrics for comparing different continual learning approaches. To address this, we present TELLA, a tool for the Test and Evaluation of Lifelong Learning Agents. TELLA provides specified, reproducible curricula to lifelong learning agents while logging detailed data for evaluation and standardized analysis. Researchers can define and share their own curricula over various learning environments or run against a curriculum created under the DARPA Lifelong Learning Machines (L2M) Program.


title: Monte Carlo twisting for particle filters

abstract: We consider the problem of designing efficient particle filters for twisted Feynman--Kac models. Particle filters using twisted models can deliver low error approximations of statistical quantities and such twisting functions can be learnt iteratively. Practical implementations of these algorithms are complicated by the need to (i) sample from the twisted transition dynamics, and (ii) calculate the twisted potential functions. We expand the class of applicable models using rejection sampling for (i) and unbiased approximations for (ii) using a random weight particle filter. We characterise the average acceptance rates within the particle filter in order to control the computational cost, and analyse the asymptotic variance. Empirical results show the mean squared error of the normalising constant estimate in our method is smaller than a memory-equivalent particle filter but not a computation-equivalent filter. Both comparisons are improved when more efficient sampling is possible which we demonstrate on a stochastic volatility model.


title: Digital Twins: Potentials, Ethical Issues, and Limitations

abstract: After Big Data and Artificial Intelligence (AI), the subject of Digital Twins has emerged as another promising technology, advocated, built, and sold by various IT companies. The approach aims to produce highly realistic models of real systems. In the case of dynamically changing systems, such digital twins would have a life, i.e. they would change their behaviour over time and, in perspective, take decisions like their real counterparts \textemdash so the vision. In contrast to animated avatars, however, which only imitate the behaviour of real systems, like deep fakes, digital twins aim to be accurate "digital copies", i.e. "duplicates" of reality, which may interact with reality and with their physical counterparts. This chapter explores, what are possible applications and implications, limitations, and threats.


title: Partial compositeness under precision scrutiny

abstract: We revisit the impact of top partial compositeness on electroweak precision observables in the misaligned vacuum basis. We identify a new source for $S$ in the singlet mixing case, and for $S$-$T$ in the bi-doublet mixing, stemming from misalignment in the gauge couplings of the top partners. Hence, a positive shift in $T$ can be obtained in both cases, as preferred by the recent CDF measurement of the $W$ mass. These results, obtained for the minimal fundamental coset SU(4)/Sp(4), apply to any composite Higgs model with top partial compositeness.


title: Bijections, generalizations, and other properties of sequentially congruent partitions

abstract: Recently, Schneider and Schneider defined a new class of partitions called sequentially congruent partitions, in which each part is congruent to the next part modulo its index, and they proved two partition bijections involving these partitions. We introduce a new partition notation specific to sequentially congruent partitions which allows us to more easily study these bijections and their compositions, and we reinterpret them in terms of Young diagram transformations. We also define a generalization of sequentially congruent partitions, and we provide several new partition bijections for these generalized sequentially congruent partitions. Finally, we investigate a question of Schneider--Schneider regarding how sequentially congruent partitions fit into Andrews' theory of partition ideals. We prove that the maximal partition ideal of sequentially congruent partitions has infinite order and is therefore not linked, and we identify its order 1 subideals.


title: Early Results From GLASS-JWST. XVII: Building the First Galaxies -- Chapter 1. Star Formation Histories at 5<z < 7

abstract: JWST observations of high redshift galaxies are used to measure their star formation histories - the buildup of stellar mass in the earliest galaxies. Here we use a novel analysis program, SEDz*, to compare near-IR spectral energy distributions for galaxies with redshifts 5 < z < 7 to combinations of stellar population templates evolved from z = 12. We exploit NIRCam imaging in 7 wide bands covering 1-5 mu m, taken in the context of the GLASS-JWST-ERS program, and use SEDz* to solve for well-constrained star formation histories for 24 exemplary galaxies. In this first look we find a variety of histories, from long, continuous star formation over 5 < z < 12 to short but intense starbursts - sometimes repeating, and, most commonly, contiguous mass buildup lasting ~ 0.5 Myr,possibly the seeds of today's typical, M* galaxies.


title: Late-time accretion in neutron star mergers: implications for short gamma-ray bursts and kilonovae

abstract: We study the long-term (t >> 10 s) evolution of the accretion disk after a neutron star(NS)-NS or NS-black hole merger, taking into account the radioactive heating by r-process nuclei formed in the first few seconds. We find that the cumulative heating eventually exceeds the disk's binding energy at t ~ 10^2 s (\alpha/0.1)^{-1.8} (M/2.6 Msun)^{1.8} after the merger, where \alpha is the Shakura-Sunyaev viscosity parameter and M is the mass of the remnant object. This causes the disk to evaporate rapidly and the jet power to shut off. We propose that this is the cause of the steep flux decline at the end of the extended emission (EE) or X-ray plateau seen in many short gamma-ray bursts (GRBs). The shallow flux evolution before the steep decline is consistent with a plausible scenario where the jet power scales linearly with the disk mass. We suggest that the jets from NS mergers have two components -- a short-duration narrow one corresponding to the prompt gamma-ray emission and a long-lasting wide component producing the EE. This leads to a prediction that "orphan EE" (without the prompt gamma-rays) may be a promising electromagnetic counterpart for NS mergers observable by future wide-field X-ray surveys. The long-lived disk produces a slow ejecta component that can efficiently thermalize the energy carried by beta-decay electrons up to t ~ 100 d and contributes 10% of the kilonova's bolometric luminosity at these late epochs. We predict that future ground-based and JWST near-IR spectroscopy of nearby (< 100 Mpc) NS mergers will detect narrow (~0.01c) line features a few weeks after the merger, which provides a powerful probe of the atomic species formed in these events.


title: Degeneracy in the inference of phase transitions in the neutron star equation of state from gravitational wave data

abstract: Gravitational wave (GW) detections of binary neutron star inspirals will be crucial for constraining the dense matter equation of state (EoS). We demonstrate a new degeneracy in the mapping from tidal deformability data to the EoS, which occurs for models with strong phase transitions. We find that there exists a new family of EoS with phase transitions that set in at different densities and that predict neutron star radii that differ by up to ~500m, but that produce nearly identical tidal deformabilities for all neutron star masses. Next generation GW detectors and advances in nuclear theory may be needed to resolve this degeneracy.


title: Tidal Deformability Doppelgangers: Implications of a low-density phase transition in the neutron star equation of state

abstract: Studying the properties of ultra-dense matter is one of the key goals of modern neutron star research. The measurement of the tidal deformability from the inspiral of a binary neutron star merger offers one promising method for constraining the equation of state (EoS) of cold, dense matter. In this work, we report on a new class of EoSs which have significantly different pressures at nuclear densities and large differences in stellar radii, but that predict surprisingly similar tidal deformabilities across the entire range of astrophysically-observed neutron star masses. Using a survey of 5 million piecewise polytropic EoSs, subject to five different sets of nuclear priors, we demonstrate that these "tidal deformability doppelgangers" occur generically. We find that they can differ substantially in the pressure (by up to a factor of 3 at nuclear densities) and in the radius of intermediate-mass neutron stars (by up to 0.5 km), but are observationally indistinguishable in their tidal deformabilities ($\Delta\Lambda < 30$) with the sensitivity of current gravitational wave detectors. We demonstrate that this near-degeneracy in the tidal deformability is a result of allowing for a phase transition at low densities. We show that a combination of input from nuclear theory (e.g., from chiral effective field theory), X-ray observations of neutron star radii, and/or the next generation of gravitational wave detectors will be able to significantly constrain these tidal deformability doppelgangers.


title: The partial Temperley-Lieb algebra and its representations

abstract: We give a combinatorial description of a new diagram algebra, the partial Temperley--Lieb algebra, arising as the generic centralizer algebra $\mathrm{End}_{\mathbf{U}_q(\mathfrak{gl}_2)}(V^{\otimes k})$, where $V = V(0) \oplus V(1)$ is the direct sum of the trivial and natural module for the quantized enveloping algebra $\mathbf{U}_q(\mathfrak{gl}_2)$. It is a proper subalgebra of the Motzkin algebra (the $\mathbf{U}_q(\mathfrak{sl}_2)$-centralizer) of Benkart and Halverson. We prove a version of Schur--Weyl duality for the new algebras, and describe their generic representation theory.


title: Analyzing and modeling network travel patterns during the Ukraine invasion using crowd-sourced pervasive traffic data

abstract: In 2022, Ukraine is suffering an invasion which has resulted in acute impacts playing out over time and geography. This paper examines the impact of the ongoing disruption on traffic behavior using analytics as well as zonal-based network models. The methodology is a data-driven approach that utilizes obtained travel-time conditions within an evolutionary algorithm framework which infers origin-destination demand values in an automated process based on traffic assignment. Because of the automation of the implementation, numerous daily models can be approximated for multiple cities. The novelty of this paper versus the previously published core methodology includes an analysis to ensure the obtained data is appropriate since some data sources were disabled due to the ongoing disruption. Further, novelty includes a direct linkage of the analysis to the timeline of disruptions to examine the interaction in a new way. Finally, specific network metrics are identified which are particularly suited for conceptualizing the impact of conflict disruptions on traffic network conditions. The ultimate aim is to establish processes, concepts and analysis to advance the broader activity of rapidly quantifying the traffic impacts of conflict scenarios.


title: Gaze Estimation Approach Using Deep Differential Residual Network

abstract: Gaze estimation, which is a method to determine where a person is looking at given the person's full face, is a valuable clue for understanding human intention. Similarly to other domains of computer vision, deep learning (DL) methods have gained recognition in the gaze estimation domain. However, there are still gaze calibration problems in the gaze estimation domain, thus preventing existing methods from further improving the performances. An effective solution is to directly predict the difference information of two human eyes, such as the differential network (Diff-Nn). However, this solution results in a loss of accuracy when using only one inference image. We propose a differential residual model (DRNet) combined with a new loss function to make use of the difference information of two eye images. We treat the difference information as auxiliary information. We assess the proposed model (DRNet) mainly using two public datasets (1) MpiiGaze and (2) Eyediap. Considering only the eye features, DRNet outperforms the state-of-the-art gaze estimation methods with $angular-error$ of 4.57 and 6.14 using MpiiGaze and Eyediap datasets, respectively. Furthermore, the experimental results also demonstrate that DRNet is extremely robust to noise images.


title: Toric vector bundles over a discrete valuation ring and Bruhat-Tits buildings

abstract: We give a classification of rank $r$ torus equivariant vector bundles $\mathcal{E}$ on a toric scheme $\mathfrak{X}$ over a discrete valuation ring, in terms of piecewise affine maps $\Phi$ from the polyhedral complex of $\mathfrak{X}$ to the extended Bruhat-Tits building of $GL(r)$. This is an extension of Klyachko's classification of torus equivariant vector bundles on a toric variety over a field. We also give a simple criterion for equivariant splitting of $\mathcal{E}$ into a sum of toric line bundles in terms of its piecewise affine map.


title: High-gain observer for the nitrification process including sensor dynamics

abstract: Fertilization is commonly used to increase harvests. The lack of knowledge of soil properties and the excessive use of fertilizers can result in overfertilization. Current sensor technology is able to measure the concentrations of some of the involved substances only at selected locations and depths. Point measurements of adjacent sensors in coarse sensor networks can be used to infer upon the state of nitrate concentrations in the sensor surroundings. For this purpose, a high gain observer is proposed. Models of the nitrification process as well as the measurement dynamics for the observer design are derived and discretized on a grid to obtain a system of ordinary differential equations. It is shown that the nonlinearities of the model can be bounded and how the observer gain can be computed via linear matrix inequalities. Furthermore, a model reduction is proposed, which allows the consideration of more grid points. A simulation study demonstrates the proposed approach.


title: Kernel-based Global Sensitivity Analysis Obtained from a Single Data Set

abstract: Results from global sensitivity analysis (GSA) often guide the understanding of complicated input-output systems. Kernel-based GSA methods have recently been proposed for their capability of treating a broad scope of complex systems. In this paper we develop a new set of kernel GSA tools when only a single set of input-output data is available. Three key advances are made: (1) A new numerical estimator is proposed that demonstrates an empirical improvement over previous procedures. (2) A computational method for generating inner statistical functions from a single data set is presented. (3) A theoretical extension is made to define conditional sensitivity indices, which reveal the degree that the inputs carry shared information about the output when inherent input-input correlations are present. Utilizing these conditional sensitivity indices, a decomposition is derived for the output uncertainty based on what is called the optimal learning sequence of the input variables, which remains consistent when correlations exist between the input variables. While these advances cover a range of GSA subjects, a common single data set numerical solution is provided by a technique known as the conditional mean embedding of distributions. The new methodology is implemented on benchmark systems to demonstrate the provided insights.


title: Three-loop QCD corrections to the decay constant of $B_c$

abstract: Within the framework of nonrelativistic QCD (NRQCD) factorization, we compute the three-loop QCD corrections to the decay constant of $B_c$. We reconstruct the analytical expressions for the three-loop renormalization constant and the corresponding anomalous dimension affiliated with the pseudoscalar current composed of two different heavy flavors in NRQCD, which are functions of the ratio between the charm and bottom quark masses. Meanwhile, the short-distance coefficient is obtained with very high numerical accuracy. The three-loop QCD correction turns out to be overwhelmingly large. The phenomenological implication of this new piece of radiative corrections for the $B_c$ leptonic decay is also addressed.


title: Boosting neural video codecs by exploiting hierarchical redundancy

abstract: In video compression, coding efficiency is improved by reusing pixels from previously decoded frames via motion and residual compensation. We define two levels of hierarchical redundancy in video frames: 1) first-order: redundancy in pixel space, i.e., similarities in pixel values across neighboring frames, which is effectively captured using motion and residual compensation, 2) second-order: redundancy in motion and residual maps due to smooth motion in natural videos. While most of the existing neural video coding literature addresses first-order redundancy, we tackle the problem of capturing second-order redundancy in neural video codecs via predictors. We introduce generic motion and residual predictors that learn to extrapolate from previously decoded data. These predictors are lightweight, and can be employed with most neural video codecs in order to improve their rate-distortion performance. Moreover, while RGB is the dominant colorspace in neural video coding literature, we introduce general modifications for neural video codecs to embrace the YUV420 colorspace and report YUV420 results. Our experiments show that using our predictors with a well-known neural video codec leads to 38% and 34% bitrate savings in RGB and YUV420 colorspaces measured on the UVG dataset.


title: A Remark on the Rigidity of Delaunay Triangulated Plane

abstract: In \cite{Wu22}, under the uniformly acute condition, Wu showed the rigidity of the geodesic triangulated plane under Luo's discrete conformality. In this article, by modifying Wu's proof, we improve this result by weakening the uniformly acute condition to the uniformly Delaunay condition.


title: Numerical Solution of Nonlinear Periodic Optimal Control Problems Using a Fourier Integral Pseudospectral Method

abstract: This paper presents a Fourier integral pseudospectral (FIPS) method for a general class of nonlinear, periodic optimal control (OC) problems with equality and/or inequality constraints and sufficiently smooth solutions. In this scheme, the integral form of the problem is collocated at an equispaced set of nodes, and all necessary integrals are approximated using highly accurate Fourier integration matrices (FIMs). The proposed method leads to a nonlinear programming problem (NLP) with algebraic constraints, which is solved using a direct numerical optimization method. Sharp convergence and error estimates are derived for Fourier series, interpolants, and quadratures used for smooth and continuous periodic functions. Two nonlinear examples are considered to show the accuracy and efficiency of the numerical scheme.


title: Unfolded Dynamics Approach and Quantum Field Theory

abstract: We study quantization of a self-interacting scalar field within the unfolded dynamics approach. To this end we find and analyze a classical unfolded system describing 4d off-shell scalar field with a general self-interaction potential. Then we systematically construct three different but related unfolded formulations of the corresponding quantum field theory, supporting them with illustrative calculations: an unfolded functional Schwinger-Dyson system, an unfolded system for correlation functions and an unfolded effective system for vertex functions. The most curious feature we reveal is that an unfolded quantum commutator gets naturally regularized: a standard delta-function is replaced with a heat kernel, parameterized by the unfolded proper time. We also identify an auxiliary 5d system, having this proper time as a physical time, which generates 4d scalar action as its on-shell action.


title: PlaneFormers: From Sparse View Planes to 3D Reconstruction

abstract: We present an approach for the planar surface reconstruction of a scene from images with limited overlap. This reconstruction task is challenging since it requires jointly reasoning about single image 3D reconstruction, correspondence between images, and the relative camera pose between images. Past work has proposed optimization-based approaches. We introduce a simpler approach, the PlaneFormer, that uses a transformer applied to 3D-aware plane tokens to perform 3D reasoning. Our experiments show that our approach is substantially more effective than prior work, and that several 3D-specific design decisions are crucial for its success.


title: A 2D Model for Coronal Bright Points: Association with Spicules, UV bursts, Surges and EUV Coronal Jets

abstract: Coronal Bright Points (CBPs) are ubiquitous structures in the solar atmosphere composed of hot small-scale loops observed in EUV or X-Rays in the quiet Sun and coronal holes. They are key elements to understand the heating of the corona; nonetheless, basic questions regarding their heating mechanisms, the chromosphere underneath, or the effects of flux emergence in these structures remain open. We have used the Bifrost code to carry out a 2D experiment in which a coronal-hole magnetic nullpoint configuration evolves perturbed by realistic granulation. To compare with observations, synthetic SDO/AIA, Solar Orbiter EUI-HRI, and IRIS images have been computed. The experiment shows the self-consistent creation of a CBP through the action of the stochastic granular motions alone, mediated by magnetic reconnection in the corona. The reconnection is intermittent and oscillatory, and it leads to coronal and transition-region temperature loops that are identifiable in our EUV/UV observables. During the CBP lifetime, convergence and cancellation at the surface of its underlying opposite polarities takes place. The chromosphere below the CBP shows a number of peculiar features concerning its density and the spicules in it. The final stage of the CBP is eruptive: magnetic flux emergence at the granular scale disrupts the CBP topology, leading to different ejections, such as UV bursts, surges, and EUV coronal jets. Apart from explaining observed CBP features, our results pave the way for further studies combining simulations and coordinated observations in different atmospheric layers.


title: 3D Vision with Transformers: A Survey

abstract: The success of the transformer architecture in natural language processing has recently triggered attention in the computer vision field. The transformer has been used as a replacement for the widely used convolution operators, due to its ability to learn long-range dependencies. This replacement was proven to be successful in numerous tasks, in which several state-of-the-art methods rely on transformers for better learning. In computer vision, the 3D field has also witnessed an increase in employing the transformer for 3D convolution neural networks and multi-layer perceptron networks. Although a number of surveys have focused on transformers in vision in general, 3D vision requires special attention due to the difference in data representation and processing when compared to 2D vision. In this work, we present a systematic and thorough review of more than 100 transformers methods for different 3D vision tasks, including classification, segmentation, detection, completion, pose estimation, and others. We discuss transformer design in 3D vision, which allows it to process data with various 3D representations. For each application, we highlight key properties and contributions of proposed transformer-based methods. To assess the competitiveness of these methods, we compare their performance to common non-transformer methods on 12 3D benchmarks. We conclude the survey by discussing different open directions and challenges for transformers in 3D vision. In addition to the presented papers, we aim to frequently update the latest relevant papers along with their corresponding implementations at: https://github.com/lahoud/3d-vision-transformers.