title: Mean field elastic moduli of a three-dimensional cell-based vertex model

abstract: The mechanics of a foam typically depends on the bubble geometry, topology, and the material at hand, be it metallic or polymeric, for example. While the foam energy functional for each bubble is typically minimization of surface area for a given volume, biology provides us with a wealth of additional energy functionals, should one consider biological cells as a foam-like material. Here, we focus on a mean field approach to obtain the elastic moduli, within linear response, for an ordered, three-dimensional vertex model using the space-filling shape of a truncated octahedron and whose energy functional is characterized by a restoring surface area spring and a restoring volume spring. The tuning of the three-dimensional shape index exhibits a rigidity transition via a compatible-incompatible transition. Specifically, for smaller shape indices, both the target surface area and volume cannot be achieved, while beyond some critical value of the three-dimensional shape index, they can be, resulting in a zero-energy state. As the elastic moduli depend on curvatures of the energy when the system, we obtain these as well. In addition to analytically determining the location of the transition in mean field, we find that the rigidity transition and the elastic moduli depend on the parameterization of the cell shape with this effect being more pronounced in three dimensions given the array of shapes that a polyhedron can take on (as compared to a polygon). We also uncover nontrivial dependence on the deformation protocol in which some deformations result in affine motion of the vertices, while others result in nonaffine motion. Such dependencies on the shape parameterization and deformation protocol give rise to a nontrivial shape landscape and, therefore, nontrivial mechanical response even in the absence of topology changes.


title: Admissibility over semi-global fields in the bad characteristic case

abstract: A finite group $G$ is said to be admissible over a field $F$ if there exists a division algebra $D$ central over $F$ with a maximal subfield $L$ such that $L/F$ is Galois with group $G$. In this paper we give a complete characterization of admissible groups over function fields of curves over equicharacteristic complete discretely valued fields with algebraically closed residue fields, such as the field $\overline{\mathbb{F}_P}((t))(x)$.


title: Boosting Semantic Segmentation from the Perspective of Explicit Class Embeddings

abstract: Semantic segmentation is a computer vision task that associates a label with each pixel in an image. Modern approaches tend to introduce class embeddings into semantic segmentation for deeply utilizing category semantics, and regard supervised class masks as final predictions. In this paper, we explore the mechanism of class embeddings and have an insight that more explicit and meaningful class embeddings can be generated based on class masks purposely. Following this observation, we propose ECENet, a new segmentation paradigm, in which class embeddings are obtained and enhanced explicitly during interacting with multi-stage image features. Based on this, we revisit the traditional decoding process and explore inverted information flow between segmentation masks and class embeddings. Furthermore, to ensure the discriminability and informativity of features from backbone, we propose a Feature Reconstruction module, which combines intrinsic and diverse branches together to ensure the concurrence of diversity and redundancy in features. Experiments show that our ECENet outperforms its counterparts on the ADE20K dataset with much less computational cost and achieves new state-of-the-art results on PASCAL-Context dataset. The code will be released at https://gitee.com/mindspore/models and https://github.com/Carol-lyh/ECENet.


title: Pulse Profile Modelling of Thermonuclear Burst Oscillations II: Handling variability

abstract: Pulse profile modelling is a relativistic ray-tracing technique that can be used to infer masses, radii and geometric parameters of neutron stars. In a previous study, we looked at the performance of this technique when applied to thermonuclear burst oscillations from accreting neutron stars. That study showed that ignoring the variability associated with burst oscillation sources resulted in significant biases in the inferred mass and radius, particularly for the high count rates that are nominally required to obtain meaningful constraints. In this follow-on study, we show that the bias can be mitigated by slicing the bursts into shorter segments where variability can be neglected, and jointly fitting the segments. Using this approach, the systematic uncertainties on the mass and radius are brought within the range of the statistical uncertainty. With about 10$^6$ source counts, this yields uncertainties of approximately 10% for both the mass and radius. However, this modelling strategy requires substantial computational resources. We also confirm that the posterior distributions of the mass and radius obtained from multiple bursts of the same source can be merged to produce outcomes comparable to that of a single burst with an equivalent total number of counts.


title: Beyond Document Page Classification: Design, Datasets, and Challenges

abstract: This paper highlights the need to bring document classification benchmarking closer to real-world applications, both in the nature of data tested ($X$: multi-channel, multi-paged, multi-industry; $Y$: class distributions and label set variety) and in classification tasks considered ($f$: multi-page document, page stream, and document bundle classification, ...). We identify the lack of public multi-page document classification datasets, formalize different classification tasks arising in application scenarios, and motivate the value of targeting efficient multi-page document representations. An experimental study on proposed multi-page document classification datasets demonstrates that current benchmarks have become irrelevant and need to be updated to evaluate complete documents, as they naturally occur in practice. This reality check also calls for more mature evaluation methodologies, covering calibration evaluation, inference complexity (time-memory), and a range of realistic distribution shifts (e.g., born-digital vs. scanning noise, shifting page order). Our study ends on a hopeful note by recommending concrete avenues for future improvements.}


title: The D(2) property for $D_8$

abstract: Wall's D(2) problem asks if a cohomologically 2-dimensional geometric 3-complex is necessarily homotopy equivalent to a geometric 2-complex. We solve part of the problem when the fundamental group is dihedral of order $2^n$, and offer a complete solution for the case where it is $D_8$ the dihedral group of order 8.


title: Can Linguistic Knowledge Improve Multimodal Alignment in Vision-Language Pretraining?

abstract: The multimedia community has shown a significant interest in perceiving and representing the physical world with multimodal pretrained neural network models, and among them, the visual-language pertaining (VLP) is, currently, the most captivating topic. However, there have been few endeavors dedicated to the exploration of 1) whether essential linguistic knowledge (e.g., semantics and syntax) can be extracted during VLP, and 2) how such linguistic knowledge impact or enhance the multimodal alignment. In response, here we aim to elucidate the impact of comprehensive linguistic knowledge, including semantic expression and syntactic structure, on multimodal alignment. Specifically, we design and release the SNARE, the first large-scale multimodal alignment probing benchmark, to detect the vital linguistic components, e.g., lexical, semantic, and syntax knowledge, containing four tasks: Semantic structure, Negation logic, Attribute ownership, and Relationship composition. Based on our proposed probing benchmarks, our holistic analyses of five advanced VLP models illustrate that the VLP model: i) shows insensitivity towards complex syntax structures and relies on content words for sentence comprehension; ii) demonstrates limited comprehension of combinations between sentences and negations; iii) faces challenges in determining the presence of actions or spatial relationships within visual information and struggles with verifying the correctness of triple combinations. We make our benchmark and code available at \url{https://github.com/WangFei-2019/SNARE/}.


title: Unified Data Management and Comprehensive Performance Evaluation for Urban Spatial-Temporal Prediction [Experiment, Analysis & Benchmark]

abstract: The field of urban spatial-temporal prediction is advancing rapidly with the development of deep learning techniques and the availability of large-scale datasets. However, challenges persist in accessing and utilizing diverse urban spatial-temporal datasets from different sources and stored in different formats, as well as determining effective model structures and components with the proliferation of deep learning models. This work addresses these challenges and provides three significant contributions. Firstly, we introduce "atomic files", a unified storage format designed for urban spatial-temporal big data, and validate its effectiveness on 40 diverse datasets, simplifying data management. Secondly, we present a comprehensive overview of technological advances in urban spatial-temporal prediction models, guiding the development of robust models. Thirdly, we conduct extensive experiments using diverse models and datasets, establishing a performance leaderboard and identifying promising research directions. Overall, this work effectively manages urban spatial-temporal data, guides future efforts, and facilitates the development of accurate and efficient urban spatial-temporal prediction models. It can potentially make long-term contributions to urban spatial-temporal data management and prediction, ultimately leading to improved urban living standards.


title: The regularization of Dotsenko--Fateev integrals

abstract: We discuss the regularization of certain hypergeometric integrals appearing in 2D CFT, a step needed in the construction of the BPZ minimal models via the Coulomb gas formalism. The method is a generalization of Pochhammer's regularization of the Euler Beta-function. The constructions of the relevant homology classes are inspired by a recent singular-geometric analysis of the Dotsenko--Fateev integrand.


title: A limit of nonplanar 5-body central configurations is nonplanar

abstract: Moeckel (1990), Moeckel and Sim\'o (1995) proved that, while continuously changing the masses, a 946-body planar central configuration bifurcates into a spatial central configuration. We show that this kind of bifurcation does not occur with 5 bodies. Question 17 in the list Albouy & al (2012) is thus answered negatively.


title: CDAN: Convolutional Dense Attention-guided Network for Low-light Image Enhancement

abstract: Low-light images, characterized by inadequate illumination, pose challenges of diminished clarity, muted colors, and reduced details. Low-light image enhancement, an essential task in computer vision, aims to rectify these issues by improving brightness, contrast, and overall perceptual quality, thereby facilitating accurate analysis and interpretation. This paper introduces the Convolutional Dense Attention-guided Network (CDAN), a novel solution for enhancing low-light images. CDAN integrates an autoencoder-based architecture with convolutional and dense blocks, complemented by an attention mechanism and skip connections. This architecture ensures efficient information propagation and feature learning. Furthermore, a dedicated post-processing phase refines color balance and contrast. Our approach demonstrates notable progress compared to state-of-the-art results in low-light image enhancement, showcasing its robustness across a wide range of challenging scenarios. Our model performs remarkably on benchmark datasets, effectively mitigating under-exposure and proficiently restoring textures and colors in diverse low-light scenarios. This achievement underscores CDAN's potential for diverse computer vision tasks, notably enabling robust object detection and recognition in challenging low-light conditions.


title: Forming Gas Giants Around a Range of Protostellar M-dwarfs by Gas Disk Gravitational Instability

abstract: Recent discoveries of gas giant exoplanets around M-dwarfs (GEMS) from transiting and radial velocity (RV) surveys are difficult to explain with core-accretion models. We present here a homogeneous suite of 162 models of gravitationally unstable gaseous disks. These models represent an existence proof for gas giants more massive than 0.1 Jupiter masses to form by the gas disk gravitational instability (GDGI) mechanism around M-dwarfs for comparison with observed exoplanet demographics and protoplanetary disk mass estimates for M-dwarf stars. We use the Enzo 2.6 adaptive mesh refinement (AMR) 3D hydrodynamics code to follow the formation and initial orbital evolution of gas giant protoplanets in gravitationally unstable gaseous disks in orbit around M-dwarfs with stellar masses ranging from 0.1 $M_\odot$ to 0.5 $M_\odot$. The gas disk masses are varied over a range from disks that are too low in mass to form gas giants rapidly to those where numerous gas giants are formed, therefore revealing the critical disk mass necessary for gas giants to form by the GDGI mechanism around M-dwarfs. The disk masses vary from 0.01 $M_\odot$ to 0.05 $M_\odot$ while the disk to star mass ratios explored range from 0.04 to 0.3. The models have varied initial outer disk temperatures (10 K to 60 K) and varied levels of AMR grid spatial resolution, producing a sample of expected gas giant protoplanets for each star mass. Broadly speaking, disk masses of at least 0.02 $M_\odot$ are needed for the GDGI mechanism to form gas giant protoplanets around M-dwarfs.


title: On the mechanism of "tulip flame" formation: the effect of ignition sources

abstract: The early stages of hydrogen-air flame dynamics and the physical mechanism of tulip flame formation were studied using high-resolution numerical simulations to solve the two-dimensional fully compressible Navier-Stokes equations coupled with a one-step chemical model, which was calibrated to obtain the correct the laminar flame velocity-pressure dependence. The formation of tulip flames was investigated for a flame ignited by a spark or by a planar ignition and propagating to the opposite closed or open end. For a flame ignited by a spark on-axis at the closed end of the tube and propagating to the opposite closed or open end, a tulip flame is created by a tulip-shaped axial velocity profile in the unburned gas flow near the flame front caused by the rarefaction wave(s) created by the flame during the deceleration stage(s). It is shown that, in a tube with both closed ends, this mechanism of tulip flame formation also holds for flames initiated by planar ignition. The deceleration stages in the case of planar ignition are caused by collisions of the flame front with pressure waves reflected from the opposite end of the tube. In the case of a flame initiated by planar ignition and propagating toward the open end, the mechanism of tulip flame formation is related to the stretching of the flame skirt edges backward along the side wall of the tube due to wall friction, which leads to the formation of bulges in the flame front near the tube walls. The bulges grow and finally meet at the axis of the tube, forming a tulip-shaped flame. Regardless of the method of flame initiation at the closed end, no distorted tulip flame is formed when the flame propagates to the open end of the tube.


title: The third homotopy module of a 2-complex

abstract: Given a connected 2-complex X with fundamental group G, we show how pi_3(X) may be computed as a module over Z[G]. Further we show that if X is a finite connected 2-complex with G (the fundamental group) finite of odd order, then the stable class of pi_3(X) is determined by G.


title: Tracing Dense Gas in Six Resolved GMCs of the Andromeda Galaxy

abstract: We present dense-gas--tracing molecular observations of six resolved Giant Molecular Clouds (GMCs) in the Andromeda Galaxy (M31). Using the NOEMA interferometer, we observed the transitions of HCN(1-0), HCO$^+$(1-0), and HNC(1-0), as well as $^{13}$CO(1-0) and 100 GHz continuum emission. This complements our earlier work with the Submillimeter Array (SMA), including resolved dust continuum detections of these clouds at 230 GHz. In this work, we first compare different continuum measurements to conclude that the average free-free contamination of the observed flux is 71% at 3 mm but only 13% at 1 mm, confirming that emission at 3 mm is less reliable than that at 1 mm for calculating dust masses of star-forming clouds. While the $^{13}$CO emission is more extended than both HCN and HCO$^+$ emission, which in turn is more extended than HNC emission, we find that both HCN and HCO$^+$ are spatially coincident with, and similarly extended as, the 230 GHz dust emission. This suggests that both the 230 GHz dust continuum and most importantly the HCN emission traces the dense gas component of these GMCs. From comparison of the molecular emission with dust masses derived from the 230 GHz continuum emission, we obtain the first direct measurements of the dust-mass-to-light ratios ($\alpha^\prime_{HCN}$ and $\alpha^\prime_{HCO^+}$) in GMCs of an external galaxy. For HCN, the result is broadly similar to a measurement in the local Perseus cloud suggesting that these are indeed dense gas conversion factors. A larger cloud sample will be required to assess whether HCN is tracing comparable cloud-scale density regimes across the environments of M31.


title: New time domain decomposition methods for parabolic control problems I: Dirichlet-Neumann and Neumann-Dirichlet algorithms

abstract: We present new Dirichlet-Neumann and Neumann-Dirichlet algorithms with a time domain decomposition applied to unconstrained parabolic optimal control problems. After a spatial semi-discretization, we use the Lagrange multiplier approach to derive a coupled forward-backward optimality system, which can then be solved using a time domain decomposition. Due to the forward-backward structure of the optimality system, three variants can be found for the Dirichlet-Neumann and Neumann-Dirichlet algorithms. We analyze their convergence behavior and determine the optimal relaxation parameter for each algorithm. Our analysis reveals that the most natural algorithms are actually only good smoothers, and there are better choices which lead to efficient solvers. We illustrate our analysis with numerical experiments.


title: POLCA: Power Oversubscription in LLM Cloud Providers

abstract: Recent innovation in large language models (LLMs), and their myriad use-cases have rapidly driven up the compute capacity demand for datacenter GPUs. Several cloud providers and other enterprises have made substantial plans of growth in their datacenters to support these new workloads. One of the key bottleneck resources in datacenters is power, and given the increasing model sizes of LLMs, they are becoming increasingly power intensive. In this paper, we show that there is a significant opportunity to oversubscribe power in LLM clusters. Power oversubscription improves the power efficiency of these datacenters, allowing more deployable servers per datacenter, and reduces the deployment time, since building new datacenters is slow. We extensively characterize the power consumption patterns of a variety of LLMs and their configurations. We identify the differences between the inference and training power consumption patterns. Based on our analysis of these LLMs, we claim that the average and peak power utilization in LLM clusters for inference should not be very high. Our deductions align with the data from production LLM clusters, revealing that inference workloads offer substantial headroom for power oversubscription. However, the stringent set of telemetry and controls that GPUs offer in a virtualized environment, makes it challenging to have a reliable and robust power oversubscription mechanism. We propose POLCA, our framework for power oversubscription that is robust, reliable, and readily deployable for GPU clusters. Using open-source models to replicate the power patterns observed in production, we simulate POLCA and demonstrate that we can deploy 30% more servers in the same GPU cluster for inference, with minimal performance loss


title: Efficient assessment of window views in high-rise, high-density urban areas using 3D color City Information Models

abstract: Urban-scale quantification of window views can inform housing selection and valuation, landscape management, and urban planning. However, window views are numerous in high-rise, high-density urban areas and current automatic assessments of window views are inaccurate and time-consuming. Thus, both accurate and efficient assessment of window views is significant in improving the automation for urban-scale window view applications. The paper presents an automatic, accurate, and efficient assessment of window view indices (WVIs) of greenery, sky, waterbody, and construction using 3D color City Information Models (CIMs). The workflow includes: i) 3D semantic segmentation of photorealistic CIM and Digital Surface Model (DSM), and ii) batch computation of WVIs. Experimental results showed the estimated WVIs were more accurate (RMSE < 0.01), and the proposed method was more efficient (3.68 times faster) than Li et al.'s (2022) 2D semantic segmentation. Thus, the proposed method can facilitate large-scale WVI assessment and update in healthy high-rise, high-density urban development.


title: SCoRD: Subject-Conditional Relation Detection with Text-Augmented Data

abstract: We propose Subject-Conditional Relation Detection SCoRD, where conditioned on an input subject, the goal is to predict all its relations to other objects in a scene along with their locations. Based on the Open Images dataset, we propose a challenging OIv6-SCoRD benchmark such that the training and testing splits have a distribution shift in terms of the occurrence statistics of $\langle$subject, relation, object$\rangle$ triplets. To solve this problem, we propose an auto-regressive model that given a subject, it predicts its relations, objects, and object locations by casting this output as a sequence of tokens. First, we show that previous scene-graph prediction methods fail to produce as exhaustive an enumeration of relation-object pairs when conditioned on a subject on this benchmark. Particularly, we obtain a recall@3 of 83.8% for our relation-object predictions compared to the 49.75% obtained by a recent scene graph detector. Then, we show improved generalization on both relation-object and object-box predictions by leveraging during training relation-object pairs obtained automatically from textual captions and for which no object-box annotations are available. Particularly, for $\langle$subject, relation, object$\rangle$ triplets for which no object locations are available during training, we are able to obtain a recall@3 of 33.80% for relation-object pairs and 26.75% for their box locations.


title: On Popularity Bias of Multimodal-aware Recommender Systems: a Modalities-driven Analysis

abstract: Multimodal-aware recommender systems (MRSs) exploit multimodal content (e.g., product images or descriptions) as items' side information to improve recommendation accuracy. While most of such methods rely on factorization models (e.g., MFBPR) as base architecture, it has been shown that MFBPR may be affected by popularity bias, meaning that it inherently tends to boost the recommendation of popular (i.e., short-head) items at the detriment of niche (i.e., long-tail) items from the catalog. Motivated by this assumption, in this work, we provide one of the first analyses on how multimodality in recommendation could further amplify popularity bias. Concretely, we evaluate the performance of four state-of-the-art MRSs algorithms (i.e., VBPR, MMGCN, GRCN, LATTICE) on three datasets from Amazon by assessing, along with recommendation accuracy metrics, performance measures accounting for the diversity of recommended items and the portion of retrieved niche items. To better investigate this aspect, we decide to study the separate influence of each modality (i.e., visual and textual) on popularity bias in different evaluation dimensions. Results, which demonstrate how the single modality may augment the negative effect of popularity bias, shed light on the importance to provide a more rigorous analysis of the performance of such models.


title: Matter relative to quantum hypersurfaces

abstract: We explore the canonical description of a scalar field as a parameterized field theory on an extended phase space that includes additional embedding fields that characterize spacetime hypersurfaces $\mathsf{X}$ relative to which the scalar field is described. This theory is quantized via the Dirac prescription and physical states of the theory are used to define conditional wave functionals $|\psi_\phi[\mathsf{X}]\rangle$ interpreted as the state of the field relative to the hypersurface $\mathsf{X}$, thereby extending the Page-Wootters formalism to quantum field theory. It is shown that this conditional wave functional satisfies the Tomonaga-Schwinger equation, thus demonstrating the formal equivalence between this extended Page-Wootters formalism and standard quantum field theory. We also construct relational Dirac observables and define a quantum deparameterization of the physical Hilbert space leading to a relational Heisenberg picture, which are both shown to be unitarily equivalent to the Page-Wootters formalism. Moreover, by treating hypersurfaces as quantum reference frames, we extend recently developed quantum frame transformations to changes between classical and nonclassical hypersurfaces. This allows us to exhibit the transformation properties of a quantum field under a larger class of transformations, which leads to a frame-dependent particle creation effect.


title: Test the Weak Cosmic Supervision Conjecture in Dark Matter-Black Hole System

abstract: There is a possibility that the event horizon of a Kerr-like black hole with perfect fluid dark matter (DM) can be destroyed, providing a potential opportunity for understanding the weak cosmic censorship conjecture of black holes. In this study, we analyze the influence of the strength parameter of perfect fluid DM on the destruction of the event horizon of a Kerr-like black hole with spinning after injecting a test particle and a scalar field. We find that, when a test particle is incident on the black hole, the event horizon is destroyed by perfect fluid dark matter for extremal black holes. For nearly extremal black holes, when the dark matter parameter satisfies $\alpha \in \left (-r_{h} , 0\right ) \cup \left ( r_{h} ,k_2\right )$ i.e.$(A<0)$, the event horizon of the black hole will not be destroyed; when the dark matter parameter satisfies $\alpha \in\left ( k_1 ,-r_{h} \right ]\cup \left[0,r_{h}\right ]$ i.e.$(A\ge 0)$, the event horizon of the black hole will be destroyed. When a classical scalar field is incident into the black hole in the extremal black hole case, we find that the range of mode patterns of the scalar field that can disrupt the black hole event horizon is different for different values of the perfect fluid dark matter strength parameter. In the nearly extremal black hole case, through our analysis, we have found when $\alpha\neq0 $ and $\alpha\neq\pm\ r_h$ i.e.$A\neq0$, the event horizon of the black hole can be disrupted. Our research results indicate that dark matter might be capable of breaking the black hole horizon, thus potentially violating the weak cosmic censorship conjecture.


title: 3D Pose Nowcasting: Forecast the Future to Improve the Present

abstract: Technologies to enable safe and effective collaboration and coexistence between humans and robots have gained significant importance in the last few years. A critical component useful for realizing this collaborative paradigm is the understanding of human and robot 3D poses using non-invasive systems. Therefore, in this paper, we propose a novel vision-based system leveraging depth data to accurately establish the 3D locations of skeleton joints. Specifically, we introduce the concept of Pose Nowcasting, denoting the capability of the proposed system to enhance its current pose estimation accuracy by jointly learning to forecast future poses. The experimental evaluation is conducted on two different datasets, providing accurate and real-time performance and confirming the validity of the proposed method on both the robotic and human scenarios.


title: Language as Reality: A Co-Creative Storytelling Game Experience in 1001 Nights using Generative AI

abstract: In this paper, we present "1001 Nights", an AI-native game that allows players lead in-game reality through co-created storytelling with the character driven by large language model. The concept is inspired by Wittgenstein's idea of the limits of one's world being determined by the bounds of their language. Using advanced AI tools like GPT-4 and Stable Diffusion, the second iteration of the game enables the protagonist, Shahrzad, to realize words and stories in her world. The player can steer the conversation with the AI King towards specific keywords, which then become battle equipment in the game. This blend of interactive narrative and text-to-image transformation challenges the conventional border between the game world and reality through a dual perspective. We focus on Shahrzad, who seeks to alter her fate compared to the original folklore, and the player, who collaborates with AI to craft narratives and shape the game world. We explore the technical and design elements of implementing such a game with an objective to enhance the narrative game genre with AI-generated content and to delve into AI-native gameplay possibilities.


title: Shallow relic gravitational wave spectrum with acoustic peak

abstract: We study the gravitational wave (GW) spectrum produced by acoustic waves in the early universe, such as would be produced by a first order phase transition, focusing on the low-frequency side of the peak. We confirm with numerical simulations the Sound Shell model prediction of a steep rise with wave number $k$ of $k^9$ to a peak whose magnitude grows at a rate $(H/k_\text{p})H$, where $H$ is the Hubble rate and $k_\text{p}$ the peak wave number, set by the peak wave number of the fluid velocity power spectrum. We also show that hitherto neglected terms give a shallower part with amplitude $(H/k_\text{p})^2$ in the range $H \lesssim k \lesssim k_\text{p}$, which in the limit of small $H/k$ rises as $k$. This linear rise has been seen in other modelling and also in direct numerical simulations. The relative amplitude between the linearly rising part and the peak therefore depends on the peak wave number of the velocity spectrum and the lifetime of the source, which in an expanding background is bounded above by the Hubble time $H^{-1}$. For slow phase transitions, which have the lowest peak wave number and the loudest signals, the acoustic GW peak appears as a localized enhancement of the spectrum, with a rise to the peak less steep than $k^9$. The shape of the peak, absent in vortical turbulence, may help to lift degeneracies in phase transition parameter estimation at future GW observatories.


title: Characterization of Potential Games: Application in Aggregative Games

abstract: The main objective of this work is to describe games which fall under title of Potential and simplify the conditions for class of aggregative games. Games classified as aggregative are ones in which, in addition to the player's own action, the payoff for each player depends on an aggregate of all the players' decision variables. In this study, we developed a method based on payoff functions to determine if a given game is potential. Then, in order to identify the Aggregative Games that fall under this class we simplified the criteria for the class of Aggregative Games. A $3$-player Cournot game, also known as an Aggregative Potential Game, is used to test the characterization criteria for Potential Games. A $4$-player Cournot game is also utilized to test the form of potential function we obtained for class of general potential games.


title: Evaluating the Vulnerabilities in ML systems in terms of adversarial attacks

abstract: There have been recent adversarial attacks that are difficult to find. These new adversarial attacks methods may pose challenges to current deep learning cyber defense systems and could influence the future defense of cyberattacks. The authors focus on this domain in this research paper. They explore the consequences of vulnerabilities in AI systems. This includes discussing how they might arise, differences between randomized and adversarial examples and also potential ethical implications of vulnerabilities. Moreover, it is important to train the AI systems appropriately when they are in testing phase and getting them ready for broader use.


title: Towards Realistic Unsupervised Fine-tuning with CLIP

abstract: The emergence of vision-language models (VLMs), such as CLIP, has spurred a significant research effort towards their application for downstream supervised learning tasks. Although some previous studies have explored the unsupervised fine-tuning of CLIP, they often rely on prior knowledge in the form of class names associated with ground truth labels. In this paper, we delve into a realistic unsupervised fine-tuning scenario by assuming that the unlabeled data might contain out-of-distribution samples from unknown classes. Furthermore, we emphasize the importance of simultaneously enhancing out-of-distribution detection capabilities alongside the recognition of instances associated with predefined class labels. To tackle this problem, we present a simple, efficient, and effective fine-tuning approach called Universal Entropy Optimization (UEO). UEO leverages sample-level confidence to approximately minimize the conditional entropy of confident instances and maximize the marginal entropy of less confident instances. Apart from optimizing the textual prompts, UEO also incorporates optimization of channel-wise affine transformations within the visual branch of CLIP. Through extensive experiments conducted across 15 domains and 4 different types of prior knowledge, we demonstrate that UEO surpasses baseline methods in terms of both generalization and out-of-distribution detection.


title: Minimal algebraic complexes over $D_{4n}$

abstract: We show that cancellation of free modules holds in the stable class $\Omega_3(\mathbb{Z})$ over dihedral groups of order $4n$. In light of a recent result on realizing $k$-invariants for these groups, this completes the proof that all all dihedral groups satisfy the D(2) property.


title: An Efficient Distributed Multi-Agent Reinforcement Learning for EV Charging Network Control

abstract: The increasing trend in adopting electric vehicles (EVs) will significantly impact the residential electricity demand, which results in an increased risk of transformer overload in the distribution grid. To mitigate such risks, there are urgent needs to develop effective EV charging controllers. Currently, the majority of the EV charge controllers are based on a centralized approach for managing individual EVs or a group of EVs. In this paper, we introduce a decentralized Multi-agent Reinforcement Learning (MARL) charging framework that prioritizes the preservation of privacy for EV owners. We employ the Centralized Training Decentralized Execution-Deep Deterministic Policy Gradient (CTDE-DDPG) scheme, which provides valuable information to users during training while maintaining privacy during execution. Our results demonstrate that the CTDE framework improves the performance of the charging network by reducing the network costs. Moreover, we show that the Peak-to-Average Ratio (PAR) of the total demand is reduced, which, in turn, reduces the risk of transformer overload during the peak hours.


title: Electron trapping in graphene quantum dots with magnetic flux

abstract: It is known that the appearance of Klein tunneling in graphene makes it hard to keep or localize electrons in a graphene-based quantum dot (GQD). However, a magnetic field can be used to temporarily confine an electron that is traveling into a GQD. The electronic states investigated here are resonances with a finite trapping time, also referred to as quasi-bound states. By subjecting the GDQ to a magnetic flux, we study the scattering phenomenon and the Aharonov-Bohm effect on the lifetime of quasi-bound states existing in a GQD. We demonstrate that the trapping time increases with the magnetic flux sustaining the trapped states for a long time even after the flux is turned off. Furthermore, we discover that the probability density within the GQD is also clearly improved. We demonstrate that the trapping time of an electron inside a GQD can be successfully extended by adjusting the magnetic flux parameters.


title: Diagnosing Infeasible Optimization Problems Using Large Language Models

abstract: Decision-making problems can be represented as mathematical optimization models, finding wide applications in fields such as economics, engineering and manufacturing, transportation, and health care. Optimization models are mathematical abstractions of the problem of making the best decision while satisfying a set of requirements or constraints. One of the primary barriers to deploying these models in practice is the challenge of helping practitioners understand and interpret such models, particularly when they are infeasible, meaning no decision satisfies all the constraints. Existing methods for diagnosing infeasible optimization models often rely on expert systems, necessitating significant background knowledge in optimization. In this paper, we introduce OptiChat, a first-of-its-kind natural language-based system equipped with a chatbot GUI for engaging in interactive conversations about infeasible optimization models. OptiChat can provide natural language descriptions of the optimization model itself, identify potential sources of infeasibility, and offer suggestions to make the model feasible. The implementation of OptiChat is built on GPT-4, which interfaces with an optimization solver to identify the minimal subset of constraints that render the entire optimization problem infeasible, also known as the Irreducible Infeasible Subset (IIS). We utilize few-shot learning, expert chain-of-thought, key-retrieve, and sentiment prompts to enhance OptiChat's reliability. Our experiments demonstrate that OptiChat assists both expert and non-expert users in improving their understanding of the optimization models, enabling them to quickly identify the sources of infeasibility.


title: On Chernoff Lower-Bound of Outage Threshold for Non-Central $\chi^2$-Distributed MIMO Beamforming Gain

abstract: The cumulative distribution function (CDF) of a non-central $\chi^2$-distributed random variable (RV) is often used when measuring the outage probability of communication systems. For adaptive transmitters, it is important but mathematically challenging to determine the outage threshold for an extreme target outage probability (e.g., $10^{-5}$ or less). This motivates us to investigate lower bounds of the outage threshold, and it is found that the one derived from the Chernoff inequality (named Cher-LB) is the most {effective} lower bound. The Cher-LB is then employed to predict the multi-antenna transmitter beamforming-gain in ultra-reliable and low-latency communication, concerning the first-order Markov time-varying channel. It is exhibited that, with the proposed Cher-LB, pessimistic prediction of the beamforming gain is made sufficiently accurate for guaranteed reliability as well as the transmit-energy efficiency.


title: Low-count Time Series Anomaly Detection

abstract: Low-count time series describe sparse or intermittent events, which are prevalent in large-scale online platforms that capture and monitor diverse data types. Several distinct challenges surface when modelling low-count time series, particularly low signal-to-noise ratios (when anomaly signatures are provably undetectable), and non-uniform performance (when average metrics are not representative of local behaviour). The time series anomaly detection community currently lacks explicit tooling and processes to model and reliably detect anomalies in these settings. We address this gap by introducing a novel generative procedure for creating benchmark datasets comprising of low-count time series with anomalous segments. Via a mixture of theoretical and empirical analysis, our work explains how widely-used algorithms struggle with the distribution overlap between normal and anomalous segments. In order to mitigate this shortcoming, we then leverage our findings to demonstrate how anomaly score smoothing consistently improves performance. The practical utility of our analysis and recommendation is validated on a real-world dataset containing sales data for retail stores.


title: Uniqueness of the 2D Euler equation on rough domains

abstract: We consider the 2D incompressible Euler equation on a bounded simply connected domain $\Omega$. We give sufficient conditions on the domain $\Omega$ so that for all initial vorticity $\omega_0 \in L^{\infty}(\Omega)$ the weak solutions are unique. Our sufficient condition is slightly more general than the condition that $\Omega$ is a $C^{1,\alpha}$ domain for some $\alpha>0$, with its boundary belonging to $H^{3/2}(\mathbb{S}^1)$. As a corollary we prove uniqueness for $C^{1,\alpha}$ domains for $\alpha >1/2$ and for convex domains which are also $C^{1,\alpha}$ domains for some $\alpha >0$. Previously uniqueness for general initial vorticity in $L^{\infty}(\Omega)$ was only known for $C^{1,1}$ domains with possibly a finite number of acute angled corners. The fundamental barrier to proving uniqueness below the $C^{1,1}$ regularity is the fact that for less regular domains, the velocity near the boundary is no longer log-Lipschitz. We overcome this barrier by defining a new change of variable which we then use to define a novel energy functional.


title: Levitation and dynamics of bodies in supersaturated fluids

abstract: A body immersed in a supersaturated fluid like carbonated water can accumulate a dynamic field of bubbles upon its surface. If the body is mobile, the attached bubbles can lift it upward against gravity, but a fluid-air interface can clean the surface of these lifting agents and the body may plummet. The process then begins anew, and continues for as long as the concentration of gas in the fluid supports it. In this work, experiments using fixed and free immersed bodies reveal fundamental features of force development and gas escape. A continuum model which incorporates the dynamics of a surface buoyancy field is used to predict the ranges of body mass and size, and fluid properties, for which the system is most dynamic, and those for which body excursions are suppressed. Simulations are then used to probe systems which are dominated by a small number of large bubbles. Body rotations at the surface are critical for driving periodic vertical motions of large bodies, which in turn can produce body wobbling, rolling, and damped surface 'bouncing' dynamics.


title: A time multiscale based data-driven approach in cyclic elasto-plasticity

abstract: Within the framework of computational plasticity, recent advances show that the quasi-static response of an elasto-plastic structure under cyclic loadings may exhibit a time multiscale behaviour. In particular, the system response can be computed in terms of time microscale and macroscale modes using a weakly intrusive multi-time Proper Generalized Decomposition (MT-PGD). In this work, such micro-macro characterization of the time response is exploited to build a data-driven model of the elasto-plastic constitutive relation. This can be viewed as a predictor-corrector scheme where the prediction is driven by the macrotime evolution and the correction is performed via a sparse sampling in space. Once the nonlinear term is forecasted, the multi-time PGD algorithm allows the fast computation of the total strain. The algorithm shows considerable gains in terms of computational time, opening new perspectives in the numerical simulation of history-dependent problems defined in very large time intervals.


title: Introductory quantum information science coursework at US institutions: Content coverage

abstract: Despite rapid growth of quantum information science and engineering (QIS/QISE) workforce development initiatives, perceived lack of agreement among faculty on core content has made prior research-based curriculum and assessment development initiatives difficult to scale. To identify areas if consensus on content coverage, we report findings from a survey of N=63 instructors teaching introductory QISE courses at US institutions of higher learning. We identify a subset of content items common across a large fraction (>=80%) of introductory QISE courses that are potentially amenable to research-based curriculum development, with an emphasis on foundational skills in mathematics, physics, and engineering. As a further guide for curriculum development, we also examine differences in content coverage by level (undergraduate/graduate) and discipline. Finally, we briefly discuss the implications of our findings for the development of a research-based QISE assessment at the postsecondary level.


title: Explicit generators for the relation module in the example of Gruenberg-Linnell

abstract: Gruenberg and Linnell showed that the standard relation module of a free product of $n$ groups of the form $C_r \times \mathbb{Z}$ could be generated by just $n+1$ generators, raising the possibility of a relation gap. We explicitly give such a set of generators.


title: Fragility of surface states in non-Wigner Dyson topological insulators

abstract: Topological insulators and superconductors support extended surface states protected against the otherwise localizing effects of static disorder. Specifically, in the Wigner-Dyson insulators belonging to the symmetry classes A, AI, and AII, a band of extended surface states is continuously connected to a likewise extended set of bulk states forming a ``bridge'' between different surfaces via the mechanism of spectral flow. In this work we show that this mechanism is absent in the majority of non-Wigner-Dyson topological superconductors and chiral topological insulators. In these systems, there is precisely one point with granted extended states, the center of the band, $E=0$. Away from it, states are spatially localized, or can be made so by the addition of spatially local potentials. Considering the three-dimensional insulator in class AIII and winding number $\nu=1$ as a paradigmatic case study, we discuss the physical principles behind this phenomenon, and its methodological and applied consequences. In particular, we show that low-energy Dirac approximations in the description of surface states can be treacherous in that they tend to conceal the localizability phenomenon. We also identify markers defined in terms of Berry curvature as measures for the degree of state localization in lattice models, and back our analytical predictions by extensive numerical simulations. A main conclusion of this work is that the surface phenomenology of non-Wigner-Dyson topological insulators is a lot richer than that of their Wigner-Dyson siblings, extreme limits being spectrum-wide quantum critical delocalization of all states vs. full localization except at the $E=0$ critical point. As part of our study we identify possible experimental signatures distinguishing between these different alternatives in transport or tunnel spectroscopy.


title: Effect of shape asymmetry on percolation of aligned and overlapping objects on lattices

abstract: We investigate the percolation transition of aligned, overlapping, non-symmetrical shapes on lattices. Using the recently proposed lattice version of excluded volume theory, we show that shape-asymmetry leads to some intriguing consequences regarding the percolation behavior of asymmetric shapes. We consider a prototypical asymmetric shape - rectangle - on a square lattice and show that for rectangles of width unity (sticks), the percolation threshold is a monotonically decreasing function of the stick length, whereas, for rectangles of width greater than two, it is a monotonically increasing function. Interestingly, for rectangles of width two, the percolation threshold is independent of its length. The limiting case of the length of the rectangles going to infinity shows that the limiting threshold value is finite and depends upon the width of the rectangle. Unlike the case of symmetrical shapes like squares, there seems to be no continuum percolation problem that corresponds to this limit. We show that similar results hold for other asymmetric shapes and lattices. The critical properties of the aligned and overlapping rectangles are evaluated using Monte Carlo simulations. We find that the threshold values given by the lattice-excluded volume theory are in good agreement with the simulation results, especially for larger rectangles. We verify the isotropy of the percolation threshold and also compare our results with models where rectangles of mixed orientation are allowed. Our simulation results show that alignment increases the percolation threshold. The calculation of critical exponents places the model in the standard percolation universality class. Our results show that shape-anisotropy of the aligned, overlapping percolating units has a marked influence on the percolation properties, especially when a subset of the dimensions of the percolation units are made to diverge.


title: Quantum-enhanced magnetometry at optimal number density

abstract: We study the use of squeezed probe light and evasion of measurement back-action to enhance the sensitivity and measurement bandwidth of an optically-pumped magnetometer (OPM) at sensitivity-optimal atom number density. By experimental observation, and in agreement with quantum noise modeling, a spin-exchange-limited OPM probed with off-resonance laser light is shown to have an optimal sensitivity determined by density-dependent quantum noise contributions. Application of squeezed probe light boosts the OPM sensitivity beyond this laser-light optimum, allowing the OPM to achieve sensitivities that it cannot reach with coherent-state probing at any density. The observed quantum sensitivity enhancement at optimal number density is enabled by measurement back-action evasion.


title: Links Between Optical and X-ray Light in Scorpius X-1

abstract: We observed the low-mass X-ray binary Sco X-1 for 12 nights simultaneously using the Rossi X-Ray Timing Explorer and the Otto Struve Telescope at McDonald Observatory at 1 second time resolution. This is among the most comprehensive simultaneous X-Ray/optical data sets of Sco X-1. Evidence of reprocessing was observed in the form of nine positive, near-zero lag peaks in the cross correlation function, eight of which were relatively small and took the shape of piecewise exponential functions. These peaks were initially identified by eye, after which a computational identification scheme was developed to confirm their significance. Based on their short lags (less than 4 seconds), as well as their occurrence on the flaring branch and soft apex, the small cross correlation features are likely to be caused by reprocessing off the outer disc, although the companion could still make a contribution to their tails. The Z track was parameterized using a rank number scheme so that the system's location on the track could be numerically defined. Plotting the results against the optical reveals an increasing step function when moving from the horizontal to the normal to the flaring branch, with differential optical levels at ~0.47, ~0.57, and ~1.1 respectively. An additional correlation between Z track location and the optical was found on the upper flaring branch. An optical intensity histogram reveals a transition region between the normal and flaring branches with only intermediate fluxes.


title: Cluster algebras in Lie and Knot theory

abstract: This is a survey article on some connections between cluster algebras and link invariants, written for the Notices of the AMS.


title: On the regularity problem for parabolic operators and the role of half-time derivative

abstract: In this paper we present the following result on regularity of solutions of the second order parabolic equation $\partial_t u - \mbox{div} (A \nabla u)+B\cdot \nabla u=0$ on cylindrical domains of the form $\Omega=\mathcal O\times\mathbb R$ where $\mathcal O\subset\mathbb R^n$ is a uniform domain (it satisfies both corkscrew and Harnack chain conditions) and has uniformly $n-1$ rectifiable boundary. Let $u$ be a solution of such PDE in $\Omega$ and the non-tangential maximal function of its gradient in spatial directions $\tilde{N}(\nabla u)$ belongs to $L^p(\partial\Omega)$ for some $p>1$. Furthermore, assume that for $u|_{\partial\Omega}=f$ we have that $D^{1/2}_tf\in L^p(\partial\Omega)$. Then both $\tilde{N}(D^{1/2}_t u)$ and $\tilde{N}(D^{1/2}_tH_t u)$ also belong to $L^p(\partial\Omega)$, where $D^{1/2}_t$ and $H_t$ are the half-derivative and the Hilbert transform in the time variable, respectively. We expect this result will spur new developments in the study of solvability of the $L^p$ parabolic Regularity problem as thanks to it it is now possible to formulate the parabolic Regularity problem on a large class of time-varying domains.


title: Panoptic-Depth Color Map for Combination of Depth and Image Segmentation

abstract: Image segmentation and depth estimation are crucial tasks in computer vision, especially in autonomous driving scenarios. Although these tasks are typically addressed separately, we propose an innovative approach to combine them in our novel deep learning network, Panoptic-DepthLab. By incorporating an additional depth estimation branch into the segmentation network, it can predict the depth of each instance segment. Evaluating on Cityscape dataset, we demonstrate the effectiveness of our method in achieving high-quality segmentation results with depth and visualize it with a color map. Our proposed method demonstrates a new possibility of combining different tasks and networks to generate a more comprehensive image recognition result to facilitate the safety of autonomous driving vehicles.


title: Perspective-aware Convolution for Monocular 3D Object Detection

abstract: Monocular 3D object detection is a crucial and challenging task for autonomous driving vehicle, while it uses only a single camera image to infer 3D objects in the scene. To address the difficulty of predicting depth using only pictorial clue, we propose a novel perspective-aware convolutional layer that captures long-range dependencies in images. By enforcing convolutional kernels to extract features along the depth axis of every image pixel, we incorporates perspective information into network architecture. We integrate our perspective-aware convolutional layer into a 3D object detector and demonstrate improved performance on the KITTI3D dataset, achieving a 23.9\% average precision in the easy benchmark. These results underscore the importance of modeling scene clues for accurate depth inference and highlight the benefits of incorporating scene structure in network design. Our perspective-aware convolutional layer has the potential to enhance object detection accuracy by providing more precise and context-aware feature extraction.


title: Learning Only On Boundaries: a Physics-Informed Neural operator for Solving Parametric Partial Differential Equations in Complex Geometries

abstract: Recently deep learning surrogates and neural operators have shown promise in solving partial differential equations (PDEs). However, they often require a large amount of training data and are limited to bounded domains. In this work, we present a novel physics-informed neural operator method to solve parametrized boundary value problems without labeled data. By reformulating the PDEs into boundary integral equations (BIEs), we can train the operator network solely on the boundary of the domain. This approach reduces the number of required sample points from $O(N^d)$ to $O(N^{d-1})$, where $d$ is the domain's dimension, leading to a significant acceleration of the training process. Additionally, our method can handle unbounded problems, which are unattainable for existing physics-informed neural networks (PINNs) and neural operators. Our numerical experiments show the effectiveness of parametrized complex geometries and unbounded problems.


title: Measurement of the $Z$ boson production cross-section in $pp$ collisions at $\sqrt{s} = 5.02$ TeV

abstract: The first measurement of the $Z$ boson production cross-section at centre-of-mass energy $\sqrt{s} = 5.02\,$TeV in the forward region is reported, using $pp$ collision data collected by the LHCb experiment in year 2017, corresponding to an integrated luminosity of $100 \pm 2\,\rm{pb^{-1}}$. The production cross-section is measured for final-state muons in the pseudorapidity range $2.0<\eta<4.5$ with transverse momentum $p_{\rm{T}}> 20\,\rm{GeV/}\it{c}$. The integrated cross-section is determined to be \[ \sigma_{Z \rightarrow \mu^{+}\mu^{-}} = 39.6 \pm 0.7\,(\rm{stat}) \pm 0.6\,(\rm{syst}) \pm 0.8\,(\rm{lumi}) \ \rm{pb} \] for the di-muon invariant mass in the range $60<M_{\mu\mu}<120\,\rm{GeV/}\it{c^{2}}$. This result and the differential cross-section results are in good agreement with theoretical predictions at next-to-next-to-leading order in the strong coupling. Based on a previous LHCb measurement of the $Z$ boson production cross-section in $p$Pb collisions at $\sqrt{s_{NN}}=5.02$ TeV, the nuclear modification factor $R_{p\rm{Pb}}$ is measured for the first time at this energy. The measured values are $1.2^{+0.5}_{-0.3}\,(\rm{stat}) \pm 0.1\,(\rm{syst})$ in the forward region ($1.53<y^*_{\mu}<4.03$) and $3.6^{+1.6}_{-0.9}\,(\rm{stat}) \pm 0.2\,(\rm{syst})$ in the backward region ($-4.97<y^*_{\mu}<-2.47$), where $y^*_{\mu}$ represents the muon rapidity in the centre-of-mass frame.


title: Witten index in 4d supersymmetric gauge theories

abstract: We present a review of Witten index calculations in different supersymmetric gauge theories in four dimensions: supersymmetric electrodynamics, pure N=1 supersymmetric Yang-Mills theories and also SYM theories including matter multiplets -- both with chirally symmetric and asymmetric content.


title: Excitons in twisted AA' hexagonal boron nitride bilayers

abstract: The twisted hexagonal boron nitride (hBN) bilayer has demonstrated exceptional properties, particularly the existence of electronic flat bands without needing a magic angle, suggesting strong excitonic effects. Therefore, a systematic approach is presented to study the excitonic properties of twisted AA' hBN using the Bethe-Salpeter equation based on single-particle tight-binding wave functions. These are provided by a one-particle Hamiltonian that is parameterized to describe the main features of {\it ab initio} calculations. The Bethe-Salpeter equation is then solved in the so-called excitonic transition representation, which significantly reduces the problem dimensionality by exploiting the system's symmetries. Consequently, the excitonic energies and the excitonic wave functions are obtained from the direct diagonalization of the effective two-particle Hamiltonian of the Bethe-Salpeter equation. We have studied rotation angles as low as $7.34^{\circ}$. The model allows the study of commensurate and incommensurate moir\'e patterns at much lower computational cost than the {\it ab initio} version of the Bethe-Salpeter equation. Here, using the model and effective screening of the Keldysh type, we could obtain the absorption spectra and characterize the excitonic properties of twisted hBN bilayers for different rotation angles, demonstrating how this property affects the excitonic energies and localizations of their wavefunctions.


title: Characterization of the gravitational wave spectrum from sound waves within the sound shell model

abstract: We compute the gravitational wave (GW) spectrum sourced by sound waves produced during a first-order phase transition in the radiation-dominated epoch. The correlator of the velocity field is evaluated in accordance with the sound shell model. In our derivation we include the effects of the expansion of the Universe, which are relevant in particular for sourcing processes whose time duration is comparable with the Hubble time. Our results show a causal growth at small frequencies, $\Omega_{\rm GW} \sim k^3$, possibly followed by a linear regime $\Omega_{\rm GW} \sim k$ at intermediate $k$, depending on the phase transition parameters. Around the peak, we find a steep growth that approaches the $k^9$ scaling found within the sound shell model. The resulting bump around the peak of the GW spectrum may represent a distinctive feature of GWs produced from acoustic motion. Nothing similar has been observed for vortical (magneto)hydrodynamic turbulence. Nevertheless, we find that the $k^9$ scaling is less extended than expected in the literature, and it does not necessarily appear. The dependence on the duration of the source, $\delta \tau_{\rm fin}$, is quadratic at small frequencies $k$, and proportional to $\ln^2 (1 + \delta \tau_{\rm fin} H_*)$ for an expanding Universe. At frequencies around the peak, the growth is suppressed by a factor $\Upsilon = 1 - 1/(1 + \delta \tau_{\rm fin} {H}_*)$ that becomes linear when the GW source is short. We discuss in which cases the dependence on the source duration is linear or quadratic for stationary processes. This affects the amplitude of the GW spectrum, both in the causality tail and at the peak, showing that the assumption of stationarity is a very relevant one, as far as the GW spectral shape is concerned. Finally, we present a general semi-analytical template of the resulting GW spectrum, as a function of the parameters of the phase transition.


title: Parallel-in-time quantum simulation via Page and Wootters quantum time

abstract: In the past few decades, researchers have created a veritable zoo of quantum algorithm by drawing inspiration from classical computing, information theory, and even from physical phenomena. Here we present quantum algorithms for parallel-in-time simulations that are inspired by the Page and Wooters formalism. In this framework, and thus in our algorithms, the classical time-variable of quantum mechanics is promoted to the quantum realm by introducing a Hilbert space of "clock" qubits which are then entangled with the "system" qubits. We show that our algorithms can compute temporal properties over $N$ different times of many-body systems by only using $\log(N)$ clock qubits. As such, we achieve an exponential trade-off between time and spatial complexities. In addition, we rigorously prove that the entanglement created between the system qubits and the clock qubits has operational meaning, as it encodes valuable information about the system's dynamics. We also provide a circuit depth estimation of all the protocols, showing an exponential advantage in computation times over traditional sequential in time algorithms. In particular, for the case when the dynamics are determined by the Aubry-Andre model, we present a hybrid method for which our algorithms have a depth that only scales as $\mathcal{O}(\log(N)n)$. As a by product we can relate the previous schemes to the problem of equilibration of an isolated quantum system, thus indicating that our framework enable a new dimension for studying dynamical properties of many-body systems.


title: A Thom Spectrum Model for $C_2$-Integral Brown--Gitler Spectra

abstract: A Thom spectrum model for a $C_2$-equivariant analogue of integral Brown--Gitler spectra is established and shown to have a multiplicative property. The $C_2$-equivariant spectra constructed enjoy properties analogous to classical nonequivariant integral Brown--Gitler spectra and thus may prove useful for producing splittings of $BP \langle 1 \rangle \wedge BP \langle 1 \rangle$ and $bo \wedge bo$ in the $C_2$-equivariant setting.


title: On the importance of disc chemistry in the formation of protoplanetary disc rings

abstract: Radial substructures have now been observed in a wide range of protoplanetary discs (PPDs), from young to old systems, however their formation is still an area of vigorous debate. Recent magnetohydrodynamic (MHD) simulations have shown that rings and gaps can form naturally in PPDs when non-ideal MHD effects are included. However these simulations employ ad-hoc approximations to the magnitudes of the magnetic diffusivities in order to facilitate ring growth. We replace the parametrisation of these terms with a simple chemical network and grain distribution model to calculate the non-ideal effects in a more self-consistent way. We use a range of grain distributions to simulate grain formation for different disc conditions. Including ambipolar diffusion, we find that large grain populations (> 1{\mu}m), and those including a population of very small polyaromatic hydrocarbons (PAHs) facilitate the growth of periodic, stable rings, while intermediate sized grains suppress ring formation. Including Ohmic diffusion removes the positive influence of PAHs, with only large grain populations still producing periodic ring and gap structures. These results relate closely to the degree of coupling between the magnetic field and the neutral disc material, quantified by the non-dimensional Elsasser number {\Lambda} (the ratio of magnetic forces to Coriolis force). For both the ambipolar-only and ambipolar-ohmic cases, if the total Elsasser number is initially of order unity along the disc mid-plane, ring and gap structures may develop.


title: Counting Distinct Elements Under Person-Level Differential Privacy

abstract: We study the problem of counting the number of distinct elements in a dataset subject to the constraint of differential privacy. We consider the challenging setting of person-level DP (a.k.a. user-level DP) where each person may contribute an unbounded number of items and hence the sensitivity is unbounded. Our approach is to compute a bounded-sensitivity version of this query, which reduces to solving a max-flow problem. The sensitivity bound is optimized to balance the noise we must add to privatize the answer against the error of the approximation of the bounded-sensitivity query to the true number of unique elements.


title: Branching random walks and Minkowski sum of random walks

abstract: We show that the range of a critical branching random walk conditioned to survive forever and the Minkowski sum of two independent simple random walk ranges are intersection-equivalent in any dimension $d\ge 5$, in the sense that they hit any finite set with comparable probability, as their common starting point is sufficiently far away from the set to be hit. Furthermore, we extend a discrete version of Kesten, Spitzer and Whitman's result on the law of large numbers for the volume of a Wiener sausage. Here, the sausage is made of the Minkowski sum of $N$ independent simple random walk ranges in $\mathbb{Z}^d$, with $d>2N$, and of a finite set $A\subset \mathbb{Z}^d$. When properly normalised the volume of the sausage converges to a quantity equivalent to the capacity of $A$ with respect to the kernel $K(x,y)=(1+\|x-y\|)^{2N-d}$. As a consequence, we establish a new relation between capacity and {\it branching capacity}.


title: Label Budget Allocation in Multi-Task Learning

abstract: The cost of labeling data often limits the performance of machine learning systems. In multi-task learning, related tasks provide information to each other and improve overall performance, but the label cost can vary among tasks. How should the label budget (i.e. the amount of money spent on labeling) be allocated among different tasks to achieve optimal multi-task performance? We are the first to propose and formally define the label budget allocation problem in multi-task learning and to empirically show that different budget allocation strategies make a big difference to its performance. We propose a Task-Adaptive Budget Allocation algorithm to robustly generate the optimal budget allocation adaptive to different multi-task learning settings. Specifically, we estimate and then maximize the extent of new information obtained from the allocated budget as a proxy for multi-task learning performance. Experiments on PASCAL VOC and Taskonomy demonstrate the efficacy of our approach over other widely used heuristic labeling strategies.


title: Code Llama: Open Foundation Models for Code

abstract: We release Code Llama, a family of large language models for code based on Llama 2 providing state-of-the-art performance among open models, infilling capabilities, support for large input contexts, and zero-shot instruction following ability for programming tasks. We provide multiple flavors to cover a wide range of applications: foundation models (Code Llama), Python specializations (Code Llama - Python), and instruction-following models (Code Llama - Instruct) with 7B, 13B, 34B and 70B parameters each. All models are trained on sequences of 16k tokens and show improvements on inputs with up to 100k tokens. 7B, 13B and 70B Code Llama and Code Llama - Instruct variants support infilling based on surrounding content. Code Llama reaches state-of-the-art performance among open models on several code benchmarks, with scores of up to 67% and 65% on HumanEval and MBPP, respectively. Notably, Code Llama - Python 7B outperforms Llama 2 70B on HumanEval and MBPP, and all our models outperform every other publicly available model on MultiPL-E. We release Code Llama under a permissive license that allows for both research and commercial use.


title: Directly imaging spin polarons in a kinetically frustrated Hubbard system

abstract: The emergence of quasiparticles in quantum many-body systems underlies the rich phenomenology in many strongly interacting materials. In the context of doped Mott insulators, magnetic polarons are quasiparticles that usually arise from an interplay between the kinetic energy of doped charge carriers and superexchange spin interactions. However, in kinetically frustrated lattices, itinerant spin polarons - bound states of a dopant and a spin-flip - have been theoretically predicted even in the absence of superexchange coupling. Despite their important role in the theory of kinetic magnetism, a microscopic observation of these polarons is lacking. Here we directly image itinerant spin polarons in a triangular lattice Hubbard system realised with ultracold atoms, revealing enhanced antiferromagnetic correlations in the local environment of a hole dopant. In contrast, around a charge dopant, we find ferromagnetic correlations, a manifestation of the elusive Nagaoka effect. We study the evolution of these correlations with interactions and doping, and use higher-order correlation functions to further elucidate the relative contributions of superexchange and kinetic mechanisms. The robustness of itinerant spin polarons at high temperature paves the way for exploring potential mechanisms for hole pairing and superconductivity in frustrated systems. Furthermore, our work provides microscopic insights into related phenomena in triangular lattice moir\'{e} materials.


title: BridgeData V2: A Dataset for Robot Learning at Scale

abstract: We introduce BridgeData V2, a large and diverse dataset of robotic manipulation behaviors designed to facilitate research on scalable robot learning. BridgeData V2 contains 60,096 trajectories collected across 24 environments on a publicly available low-cost robot. BridgeData V2 provides extensive task and environment variability, leading to skills that can generalize across environments, domains, and institutions, making the dataset a useful resource for a broad range of researchers. Additionally, the dataset is compatible with a wide variety of open-vocabulary, multi-task learning methods conditioned on goal images or natural language instructions. In our experiments, we train 6 state-of-the-art imitation learning and offline reinforcement learning methods on our dataset, and find that they succeed on a suite of tasks requiring varying amounts of generalization. We also demonstrate that the performance of these methods improves with more data and higher capacity models, and that training on a greater variety of skills leads to improved generalization. By publicly sharing BridgeData V2 and our pre-trained models, we aim to accelerate research in scalable robot learning methods. Project page at https://rail-berkeley.github.io/bridgedata


title: Average behaviour of Hecke eigenvalues over certain polynomial

abstract: In the article, we investigate the average behaviour of normalised Hecke eigenvalues over certain polynomials and establish an estimate for the power moments of the normalised Hecke eigenvalues of a normalised Hecke eigenform of weight $k \ge 2$ for the full modular group $SL_2(\mathbb{Z})$ over certain polynomial, given by a sum of triangular numbers with certain positive coefficients. More precisely, for each $r \in \mathbb{N}$, we obtain an asymptotic for the following sum \begin{equation*} \begin{split} \displaystyle{\sideset{}{^{\flat }}\sum_{ \alpha(\underline{x}))+1 \le X \atop \underline{x} \in {\mathbb Z}^{4}} } \lambda_{f}^{r}(\alpha(\underline{x})+1) , \\ \end{split} \end{equation*} where $\displaystyle{\sideset{}{^{\flat }}\sum}$ means that the sum runs over the square-free positive integers, and $\lambda_{f} (n)$ is the normalised $n^{\rm th}$-Hecke eigenvalue of a normalised Hecke eigenform $f \in S_{k}(SL_2(\mathbb{Z}))$, and $\alpha(\underline{x}) = \frac{1}{2} \left( x_{1}^{2}+ x_{1} + x_{2}^{2} + x_{2} + 2 ( x_{3}^{2} + x_{3}) + 4 (x_{4}^{2} + x_{4}) \right) \in {\mathbb Q}[x_{1},x_{2},x_{3},x_{4}] $ is a polynomial, and $\underline{x} = (x_{1},x_{2},x_{3},x_{4}) \in {\mathbb Z}^{4}$.


title: Homotopy lifting maps on Hochschild cohomology and connections to deformation of algebras using reduction systems

abstract: We describe the Gerstenhaber bracket structure on Hochschild cohomology of Koszul quiver algebras in terms of homotopy lifting maps. There is a projective bimodule resolution of Koszul quiver algebras that admits a comultiplicative structure. Introducing new scalars, we describe homotopy lifting maps associated to Hochschild cocycles using the comultiplicative structure. We show that the scalars can be described by some recurrence relations and we give several examples where these scalars appear in the literature. In particular, for a member of a family of quiver algebras, we describe Hochschild 2-cocycles and their associated homotopy lifting maps and determine the Maurer-Cartan elements of the quiver algebra in two ways: (i) by the use of homotopy lifting maps and (ii) by the use of a combinatorial star product that arises from the deformation of algebras using reduction systems.


title: A new framework for global data regulation

abstract: Under the current regulatory framework for data protections, the protection of human rights writ large and the corresponding outcomes are regulated largely independently from the data and tools that both threaten those rights and are needed to protect them. This separation between tools and the outcomes they generate risks overregulation of the data and tools themselves when not linked to sensitive use cases. In parallel, separation risks under-regulation if the data can be collected and processed under a less-restrictive framework, but used to drive an outcome that requires additional sensitivity and restrictions. A new approach is needed to support differential protections based on the genuinely high-risk use cases within each sector. Here, we propose a regulatory framework designed to apply not to specific data or tools themselves, but to the outcomes and rights that are linked to the use of these data and tools in context. This framework is designed to recognize, address, and protect a broad range of human rights, including privacy, and suggests a more flexible approach to policy making that is aligned with current engineering tools and practices. We test this framework in the context of open banking and describe how current privacy-enhancing technologies and other engineering strategies can be applied in this context and that of contract tracing applications. This approach for data protection regulations more effectively builds on existing engineering tools and protects the wide range of human rights defined by legislation and constitutions around the globe.


title: DLIP: Distilling Language-Image Pre-training

abstract: Vision-Language Pre-training (VLP) shows remarkable progress with the assistance of extremely heavy parameters, which challenges deployment in real applications. Knowledge distillation is well recognized as the essential procedure in model compression. However, existing knowledge distillation techniques lack an in-depth investigation and analysis of VLP, and practical guidelines for VLP-oriented distillation are still not yet explored. In this paper, we present DLIP, a simple yet efficient Distilling Language-Image Pre-training framework, through which we investigate how to distill a light VLP model. Specifically, we dissect the model distillation from multiple dimensions, such as the architecture characteristics of different modules and the information transfer of different modalities. We conduct comprehensive experiments and provide insights on distilling a light but performant VLP model. Experimental results reveal that DLIP can achieve a state-of-the-art accuracy/efficiency trade-off across diverse cross-modal tasks, e.g., image-text retrieval, image captioning and visual question answering. For example, DLIP compresses BLIP by 1.9x, from 213M to 108M parameters, while achieving comparable or better performance. Furthermore, DLIP succeeds in retaining more than 95% of the performance with 22.4% parameters and 24.8% FLOPs compared to the teacher model and accelerates inference speed by 2.7x.


title: Semi-analytical Framework for Modeling Strong Coupling of Quantum Emitters in Electromagnetic Resonators

abstract: We present a semi-analytical framework for studying interactions between quantum emitters and general electromagnetic resonators. The method relies on the Lippmann-Schwinger equation to calculate the complex resonance frequencies of the coupled system based only on a single calculation for the electromagnetic resonator without the quantum emitter and with no fitting parameters. This is in stark contrast to standard approaches in the literature, in which the properties of the coupled system are fitted from calculated spectra. As an application example, we consider a recent dielectric cavity design featuring deep subwavelength confinement of light. We find the expected anti-crossing of the emitter and cavity resonance frequencies, and comparing to independent reference calculations, we find an extraordinary quantitative agreement with a relative error below one part in ten thousand. In order to unambiguously connect with the Jaynes-Cummings model, we derive an explicit expression relating the classical description of the emitter, as modeled by a spherical inclusion with a Lorentzian material response, to the dipole moment of the corresponding quantum optical model. The combined framework therefore enables classical calculations to be used for evaluating the coupling strength entering quantum optical theories in a transparent way.


title: Symmetries of Fano varieties

abstract: We study Fano varieties endowed with a faithful action of a symmetric group, as well as analogous results for Calabi--Yau varieties, and log terminal singularities. We show the existence of a constant $m(n)$, so that every symmetric group $S_k$ acting on an $n$-dimensional Fano variety satisfies $k \leq m(n)$. We prove that $m(n)> n+\sqrt{2n}$ for every $n$. On the other hand, we show that $\lim_{n\to \infty} m(n)/(n+1)^2 \leq 1$. However, this asymptotic upper bound is not expected to be sharp. We obtain sharp bounds for certain classes of varieties. For toric varieties, we show that $m(n)=n+2$ for $n\geq 4$. For Fano quasismooth weighted complete intersections, we prove the asymptotic equality $\lim_{n\to \infty} m(n)/(n+1)=1$. Among the Fano weighted complete intersections, we study the maximally symmetric ones and show that they are closely related to the Fano--Fermat varieties, i.e., Fano complete intersections in $\mathbb P^N$ cut out by Fermat hypersurfaces. Finally, we draw a connection between maximally symmetric Fano varieties and boundedness of Fano varieties. For instance, we show that the class of $S_8$-equivariant Fano $4$-folds forms a bounded family. In contrast, the $S_7$-equivariant Fano $4$-folds are unbounded.


title: Infinite Dimensional Asymmetric Quantum Channel Discrimination

abstract: We study asymmetric binary channel discrimination, for qantum channels acting on separable Hilbert spaces. We establish quantum Stein's lemma for channels for both adaptive and parallel strategies, and show that under finiteness of the geometric R\'enyi divergence between the two channels for some $\alpha > 1$, adaptive strategies offer no asymptotic advantage over parallel ones. One major step in our argument is to demonstrate that the geometric R\'enyi divergence satisfies a chain rule and is additive for channels also in infinite dimensions. These results may be of independent interest. Furthermore, we not only show asymptotic equivalence of parallel and adaptive strategies, but explicitly construct a parallel strategy which approximates a given adaptive $n$-shot strategy, and give an explicit bound on the difference between the discrimination errors for these two strategies. This extends the finite dimensional result from [B. Bergh et al., arxiv:2206.08350]. Finally, this also allows us to conclude, that the chain rule for the Umegaki relative entropy in infinite dimensions, recently shown in [O. Fawzi, L. Gao, and M. Rahaman, arxiv:2212.14700v2] given finiteness of the max divergence between the two channels, also holds under the weaker condition of finiteness of the geometric R\'enyi divergence. We give explicit examples of channels which show that these two finiteness conditions are not equivalent.


title: Towards Realistic Zero-Shot Classification via Self Structural Semantic Alignment

abstract: Large-scale pre-trained Vision Language Models (VLMs) have proven effective for zero-shot classification. Despite the success, most traditional VLMs-based methods are restricted by the assumption of partial source supervision or ideal vocabularies, which rarely satisfy the open-world scenario. In this paper, we aim at a more challenging setting, Realistic Zero-Shot Classification, which assumes no annotation but instead a broad vocabulary. To address this challenge, we propose the Self Structural Semantic Alignment (S^3A) framework, which extracts the structural semantic information from unlabeled data while simultaneously self-learning. Our S^3A framework adopts a unique Cluster-Vote-Prompt-Realign (CVPR) algorithm, which iteratively groups unlabeled data to derive structural semantics for pseudo-supervision. Our CVPR process includes iterative clustering on images, voting within each cluster to identify initial class candidates from the vocabulary, generating discriminative prompts with large language models to discern confusing candidates, and realigning images and the vocabulary as structural semantic alignment. Finally, we propose to self-learn the CLIP image encoder with both individual and structural semantic alignment through a teacher-student learning strategy. Our comprehensive experiments across various generic and fine-grained benchmarks demonstrate that the S^3A method offers substantial improvements over existing VLMs-based approaches, achieving a more than 15% accuracy improvement over CLIP on average. Our codes, models, and prompts are publicly released at https://github.com/sheng-eatamath/S3A.


title: Less is More: Towards Efficient Few-shot 3D Semantic Segmentation via Training-free Networks

abstract: To reduce the reliance on large-scale datasets, recent works in 3D segmentation resort to few-shot learning. Current 3D few-shot semantic segmentation methods first pre-train the models on `seen' classes, and then evaluate their generalization performance on `unseen' classes. However, the prior pre-training stage not only introduces excessive time overhead, but also incurs a significant domain gap on `unseen' classes. To tackle these issues, we propose an efficient Training-free Few-shot 3D Segmentation netwrok, TFS3D, and a further training-based variant, TFS3D-T. Without any learnable parameters, TFS3D extracts dense representations by trigonometric positional encodings, and achieves comparable performance to previous training-based methods. Due to the elimination of pre-training, TFS3D can alleviate the domain gap issue and save a substantial amount of time. Building upon TFS3D, TFS3D-T only requires to train a lightweight query-support transferring attention (QUEST), which enhances the interaction between the few-shot query and support data. Experiments demonstrate TFS3D-T improves previous state-of-the-art methods by +6.93% and +17.96% mIoU respectively on S3DIS and ScanNet, while reducing the training time by -90%, indicating superior effectiveness and efficiency.


title: Motion-Guided Masking for Spatiotemporal Representation Learning

abstract: Several recent works have directly extended the image masked autoencoder (MAE) with random masking into video domain, achieving promising results. However, unlike images, both spatial and temporal information are important for video understanding. This suggests that the random masking strategy that is inherited from the image MAE is less effective for video MAE. This motivates the design of a novel masking algorithm that can more efficiently make use of video saliency. Specifically, we propose a motion-guided masking algorithm (MGM) which leverages motion vectors to guide the position of each mask over time. Crucially, these motion-based correspondences can be directly obtained from information stored in the compressed format of the video, which makes our method efficient and scalable. On two challenging large-scale video benchmarks (Kinetics-400 and Something-Something V2), we equip video MAE with our MGM and achieve up to +$1.3\%$ improvement compared to previous state-of-the-art methods. Additionally, our MGM achieves equivalent performance to previous video MAE using up to $66\%$ fewer training epochs. Lastly, we show that MGM generalizes better to downstream transfer learning and domain adaptation tasks on the UCF101, HMDB51, and Diving48 datasets, achieving up to +$4.9\%$ improvement compared to baseline methods.


title: MapPrior: Bird's-Eye View Map Layout Estimation with Generative Models

abstract: Despite tremendous advancements in bird's-eye view (BEV) perception, existing models fall short in generating realistic and coherent semantic map layouts, and they fail to account for uncertainties arising from partial sensor information (such as occlusion or limited coverage). In this work, we introduce MapPrior, a novel BEV perception framework that combines a traditional discriminative BEV perception model with a learned generative model for semantic map layouts. Our MapPrior delivers predictions with better accuracy, realism, and uncertainty awareness. We evaluate our model on the large-scale nuScenes benchmark. At the time of submission, MapPrior outperforms the strongest competing method, with significantly improved MMD and ECE scores in camera- and LiDAR-based BEV perception.


title: Dense Text-to-Image Generation with Attention Modulation

abstract: Existing text-to-image diffusion models struggle to synthesize realistic images given dense captions, where each text prompt provides a detailed description for a specific image region. To address this, we propose DenseDiffusion, a training-free method that adapts a pre-trained text-to-image model to handle such dense captions while offering control over the scene layout. We first analyze the relationship between generated images' layouts and the pre-trained model's intermediate attention maps. Next, we develop an attention modulation method that guides objects to appear in specific regions according to layout guidance. Without requiring additional fine-tuning or datasets, we improve image generation performance given dense captions regarding both automatic and human evaluation scores. In addition, we achieve similar-quality visual results with models specifically trained with layout conditions.


title: POCO: 3D Pose and Shape Estimation with Confidence

abstract: The regression of 3D Human Pose and Shape (HPS) from an image is becoming increasingly accurate. This makes the results useful for downstream tasks like human action recognition or 3D graphics. Yet, no regressor is perfect, and accuracy can be affected by ambiguous image evidence or by poses and appearance that are unseen during training. Most current HPS regressors, however, do not report the confidence of their outputs, meaning that downstream tasks cannot differentiate accurate estimates from inaccurate ones. To address this, we develop POCO, a novel framework for training HPS regressors to estimate not only a 3D human body, but also their confidence, in a single feed-forward pass. Specifically, POCO estimates both the 3D body pose and a per-sample variance. The key idea is to introduce a Dual Conditioning Strategy (DCS) for regressing uncertainty that is highly correlated to pose reconstruction quality. The POCO framework can be applied to any HPS regressor and here we evaluate it by modifying HMR, PARE, and CLIFF. In all cases, training the network to reason about uncertainty helps it learn to more accurately estimate 3D pose. While this was not our goal, the improvement is modest but consistent. Our main motivation is to provide uncertainty estimates for downstream tasks; we demonstrate this in two ways: (1) We use the confidence estimates to bootstrap HPS training. Given unlabelled image data, we take the confident estimates of a POCO-trained regressor as pseudo ground truth. Retraining with this automatically-curated data improves accuracy. (2) We exploit uncertainty in video pose estimation by automatically identifying uncertain frames (e.g. due to occlusion) and inpainting these from confident frames. Code and models will be available for research at https://poco.is.tue.mpg.de.


title: Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond

abstract: In this work, we introduce the Qwen-VL series, a set of large-scale vision-language models (LVLMs) designed to perceive and understand both texts and images. Starting from the Qwen-LM as a foundation, we endow it with visual capacity by the meticulously designed (i) visual receptor, (ii) input-output interface, (iii) 3-stage training pipeline, and (iv) multilingual multimodal cleaned corpus. Beyond the conventional image description and question-answering, we implement the grounding and text-reading ability of Qwen-VLs by aligning image-caption-box tuples. The resulting models, including Qwen-VL and Qwen-VL-Chat, set new records for generalist models under similar model scales on a broad range of visual-centric benchmarks (e.g., image captioning, question answering, visual grounding) and different settings (e.g., zero-shot, few-shot). Moreover, on real-world dialog benchmarks, our instruction-tuned Qwen-VL-Chat also demonstrates superiority compared to existing vision-language chatbots. Code, demo and models are available at https://github.com/QwenLM/Qwen-VL.


title: NeO 360: Neural Fields for Sparse View Synthesis of Outdoor Scenes

abstract: Recent implicit neural representations have shown great results for novel view synthesis. However, existing methods require expensive per-scene optimization from many views hence limiting their application to real-world unbounded urban settings where the objects of interest or backgrounds are observed from very few views. To mitigate this challenge, we introduce a new approach called NeO 360, Neural fields for sparse view synthesis of outdoor scenes. NeO 360 is a generalizable method that reconstructs 360{\deg} scenes from a single or a few posed RGB images. The essence of our approach is in capturing the distribution of complex real-world outdoor 3D scenes and using a hybrid image-conditional triplanar representation that can be queried from any world point. Our representation combines the best of both voxel-based and bird's-eye-view (BEV) representations and is more effective and expressive than each. NeO 360's representation allows us to learn from a large collection of unbounded 3D scenes while offering generalizability to new views and novel scenes from as few as a single image during inference. We demonstrate our approach on the proposed challenging 360{\deg} unbounded dataset, called NeRDS 360, and show that NeO 360 outperforms state-of-the-art generalizable methods for novel view synthesis while also offering editing and composition capabilities. Project page: https://zubair-irshad.github.io/projects/neo360.html


title: Scenimefy: Learning to Craft Anime Scene via Semi-Supervised Image-to-Image Translation

abstract: Automatic high-quality rendering of anime scenes from complex real-world images is of significant practical value. The challenges of this task lie in the complexity of the scenes, the unique features of anime style, and the lack of high-quality datasets to bridge the domain gap. Despite promising attempts, previous efforts are still incompetent in achieving satisfactory results with consistent semantic preservation, evident stylization, and fine details. In this study, we propose Scenimefy, a novel semi-supervised image-to-image translation framework that addresses these challenges. Our approach guides the learning with structure-consistent pseudo paired data, simplifying the pure unsupervised setting. The pseudo data are derived uniquely from a semantic-constrained StyleGAN leveraging rich model priors like CLIP. We further apply segmentation-guided data selection to obtain high-quality pseudo supervision. A patch-wise contrastive style loss is introduced to improve stylization and fine details. Besides, we contribute a high-resolution anime scene dataset to facilitate future research. Our extensive experiments demonstrate the superiority of our method over state-of-the-art baselines in terms of both perceptual quality and quantitative performance.


title: ROAM: Robust and Object-Aware Motion Generation Using Neural Pose Descriptors

abstract: Existing automatic approaches for 3D virtual character motion synthesis supporting scene interactions do not generalise well to new objects outside training distributions, even when trained on extensive motion capture datasets with diverse objects and annotated interactions. This paper addresses this limitation and shows that robustness and generalisation to novel scene objects in 3D object-aware character synthesis can be achieved by training a motion model with as few as one reference object. We leverage an implicit feature representation trained on object-only datasets, which encodes an SE(3)-equivariant descriptor field around the object. Given an unseen object and a reference pose-object pair, we optimise for the object-aware pose that is closest in the feature space to the reference pose. Finally, we use l-NSM, i.e., our motion generation model that is trained to seamlessly transition from locomotion to object interaction with the proposed bidirectional pose blending scheme. Through comprehensive numerical comparisons to state-of-the-art methods and in a user study, we demonstrate substantial improvements in 3D virtual character motion and interaction quality and robustness to scenarios with unseen objects. Our project page is available at https://vcai.mpi-inf.mpg.de/projects/ROAM/.


title: NeuralClothSim: Neural Deformation Fields Meet the Thin Shell Theory

abstract: Despite existing 3D cloth simulators producing realistic results, they predominantly operate on discrete surface representations (e.g. points and meshes) with a fixed spatial resolution, which often leads to large memory consumption and resolution-dependent simulations. Moreover, back-propagating gradients through the existing solvers is difficult, and they cannot be easily integrated into modern neural architectures. In response, this paper re-thinks physically plausible cloth simulation: We propose NeuralClothSim, i.e., a new quasistatic cloth simulator using thin shells, in which surface deformation is encoded in neural network weights in the form of a neural field. Our memory-efficient solver operates on a new continuous coordinate-based surface representation called neural deformation fields (NDFs); it supervises NDF equilibria with the laws of the non-linear Kirchhoff-Love shell theory with a non-linear anisotropic material model. NDFs are adaptive: They 1) allocate their capacity to the deformation details and 2) allow surface state queries at arbitrary spatial resolutions without re-training. We show how to train NeuralClothSim while imposing hard boundary conditions and demonstrate multiple applications, such as material interpolation and simulation editing. The experimental results highlight the effectiveness of our continuous neural formulation.


title: Room-temperature quantum oscillations of static magnetic susceptibility of silicon-carbide epitaxial layers grown on a silicon substrate by the method of the coordinated substitution of atoms

abstract: The article presents the results of measurement and analysis of the field dependences of the static magnetic susceptibility of thin epitaxial silicon carbide films grown on the (110) surface of single-crystal silicon by the method of the coordinated substitution of atoms. In weak magnetic fields, the occurrence of two quantum effects at room temperature was experimentally found: the hysteresis of the static magnetic susceptibility and, in the field dependences, quantum Aharonov-Bohm oscillations of the static magnetic susceptibility. The simultaneous occurrence of these effects is a consequence of two- and one-particle interference of charge carriers (two-dimensional holes) on microdefects consisting of dipole centers with negative correlation energy (negative-U dipole centers).